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Description 

Background of the Invention 

5 [0001 J The present Invention relates to image processing method and apparatus, for Improving the properties (e.g., 
Improving the comparison precision, reducing the processing amount, decreasing the amount of data, etc.) in the case 
when conducting Image processing for analyzing or recognizing a digltallzed image (e.g. , fingerprints, stamped images, 
diagrams, characters, etc.) using an Image processing apparatus (l.e., hardware/software in a computer, electronic 
switching machine, communication control unit, tC card, image recognition device, Image comparing device, Image 

10 testing unit, or the like). 

Related Art 

[0002] In the following, an example of the case in which the objective image according to the present invention Is a 

IS fingerprint will be explained. Essentially, a fingerprint is the crest pattem of the ridges of a finger. Furthennore, since 
the trough lines (the space In between the ridge lines) are defined by the ridge lines, It Is possible to use a pattern 
formed by trough lines In place of the ridge lines as a fingerprint. For the sake of convenience, the lines defining the 
fingerprint will be called "fingerprint lines". Various fingerprint Input devices exist for confimiing an Individual's identity, 
such as a method for Inputting a fingerprint from an Image pick-up unit (e.g., CCD (Charged Coupled Devtee)) camera, 

20 a prism metiiod (e.g., see Shimizu et al., "Entry Method of Fingerprint Image with a Prism - Comparison between Total 
and Light Path Separation Method", lECE Journal, vol. J68-D, No. 3, pp. 414-415 (1 985)), and a hologram method (e. 
g., see Igaki, et al., "Personal Identification Terminal Using a Holographic Fingerprint Sensor", Institute of Electronics 
and Communication Engineers of Japan (lEICE Technteal Report, PRU87-31, pp. 27-33, (1987)). 
[0003] The fingerprint image of analog information inputted from an image pick-up unit is converted into a gray-scale 

2S image of a digltallzed fingerprint by means of an analog/digital (A/D) converter. The gray-scale Image of this fingerprint 
is represented by the coordinates (X, Y) whteh are an image memory pixel address, as well as by means of the bright- 
ness of the pixels which form the structural components of each image memory pixel address. The designation method 
for the X and Y axes is optional and may be freely selected. The fingerprint Image may be formed by converting the 
concavities and convexities of the fingerprint directiy into a binary Image. 

30 [0004] Connections can then be conducted on the gray-scale image of the fingerprint by means of leveling and utilizing 
the orientation of the ridges. End points, branch points, and points of Intersection represent characteristic points which 
display the distinctive features of a fingerprint. The characteristic points of a gray-scale Image of a digitalized fingerprint 
can be detected by means of conducting binary conversion of a fingerprint image and further thinning tills Image and 
examining whether or not a pattem identical to the pattem of a range of pixels (e.g., a 3 x 3 pixel aggregation with the 

35 characteristk: point as the center) representing the characteristic point (e.g., see. Sasagawa, et al., "Personal Verifi- 
cation System with High Tolerance of Poor-Quality Rngerprints", lElCE Journal, vol. J72-D-I1 No. 5, pp. 707-71 4 (1 990)) 
exists. In the comparison of fingerprints, fingerprints for which infonnation has been previously recorded in memory 
are referred to as "registered fingerprints" (I.e., registered images or registered fingerprint images), and the flngeiprint 
which Is compared for concordance witti the aforementioned registered fingerprints are referred to as "test fingerprints" 

40 (i.e., test Images or test fingerprint images). As methods for comparing the registered fingerprints and the examined 
fingerprints, a method utilizing characteristic points, a method utilizing the orientation of the ridge lines, and a nnethod 
for matching the patterns of the original images of the examined fingerprint and the registered fingerprint are known. 
. Japanese Patent Application, First Publication. No. Sho 63-132386 discloses a method for comparing fingerprint im- 
ages, in which the ttiinned Image of an examined fingerprint and a thinned Image of the registered fingerprint are 

45 superimposed as a method for pattern matehing for thinned images (see Kubota, et al., "Fingerprint Comparing Metii- 
od"). 

[0005] Smoothing is a process for reducing the effects of noise of the fingerprint image; e.g., a local summation 
averaging filter whteh utilizes the values of neighboring pixels sunrounding a random pixel (Takagi and Shlmoda (Eds.), 
"Handbook of Image Analysis", pp. 538-548, Tokyo University Press (1991)). 

50 [0006] With regard to the thinning process of a binary image, various pixels corresponding to lines exist, such that 
the majority (in this case, "majority" means at least one-half, and ideally, the entire portion) of the line widths represent 
1 pixel. The various kinds of corresponding pixels are either black or white; in the following, an explanation will be given 
with regard to the black pixels. IHIIditch*s thinning method, in which tiie outer black pixels of a black pixel aggregation 
are sequentially deleted while maintaining the continuity betweea black pixels, is known as a method for tiilnnlng a 

55 binary image following binary conversion of the gray-scale image (4-neighbor connected or 8-nelghbor connected). In 
addition, otiier metiiods for thinning a gray-scale image or a binary vnage are also known; e.g., Tamura (Ed.), 'intro- 
duction to Computer innage Processing", Sougen Press, pp. 80-83 (1985); Tamura, "Research Relating to Multi^ided 
. Image Processing and its Software", Electrotechnk:al Laboratory Japan Research Report, pp. 25-64, No. 835 (February 
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1 984); and Mori, et al. . "Fundamentals of Image Recognition [1]", pp. 75-71 . Ohm Corporation (1986). Japanese Patent 
Application No. Hei 3-451 36 (1 991 ), 'A Thinning Method for Extracting Characteristic Points of an Image," (Kobayashi, 
et al., Institute of Electronics, Infomiation and Communication Engineers of Japan [lEICE] Technical Report. 
PRU90-149. pp. 33-38 (1 991 )) discloses a method for thinning a gray-scale image or a binary image. As for connectivity 
s between black pixels, either 4-neighborconnected or 8-neighbor connected is used. 4-neighborconnected and 8-neigh- 
bor connected are also called 4-connected and 8-connected, respectively (e.g., see "Introduction to Computer Image 
Processing", Tamura (Ed.), Soken-Suppan, pp. 70, (1985)). 

[0007] A nnethod for binary converting a gray-scale Image into a binary Image Is disclosed in Mori, et al., ("Funda- 
mentals of Image Recognition [1]", pp. 37-47, Ohm Corporation (1 986)). A p-tile method is known as a method forbinary . 
10 conversion, in whteh a binary conversion threshold value is detemnined such that the proportion of black pixels among 
all of the pixels in question following binary conversion (i.e., black or white pixels) reaches a predetemnined value (e. 
g., Takagi and Shimoda (Eds.), "Handbook of Image Analysis", p. 503, Tokyo University Press (1991)). However, this 
process cannot be directly applied to the case when binary conversion is carried out by means of dividing the Image 
Into partial regions. 

15 [0008] With regard to the Input of fingerprints, positional en-ors (rotational and parallel displacements) occur when 
comparing a test fingerprint with a registered fingerprint, and hence when canylng out comparison, It is necessary to 
align these two fingerprints. As methods for aligning the aforementioned fingerprints (rotational and parallel displace- 
ments), a method which utilizes the ridge orientation, a method which utilizes representative characteristto points and 
peripheral characteristic points, and a method whk^h applies trial and error practice over a range in which only parallel 

20 displacement is possible to produce a final position of maximum concordance, are known. Furthermore, at the time of 
aligning, a conventional method for perfomning the required coordinate and geometric transfonnations is disclosed in 
Plastock, et al., ("Theory and Problems of Computer Graphics", translated by Koriyama), pp. 84-88, McGraw Hill Books 
(1987)). 

[0009] In the aligning at the time of comparison, it is useful to caknilate the approximate center point of a fingerprint 
25 bnage. A method for cateulating the approximate center point by means of successively examining ridges with sharp 

increases in their gradients is disclosed In Japanese Patent Application, Second Publication, No. Sho 58-55548 ("A 

Method for Determining the Center Position of a Diagram"). In Ito, et al., ("An Algorithm for Classification of Fingerprints 
< Based on the Core", lEICE Technical Report, PRU 89-79, pp. 15-22 (1989)). A method for successively accessing a 

center position using the number of intersections of parallel lines of each rectangular region is disclosed. In addition, 
30 in "An Extraction Technk^ue of the Pirot Location for Automated Fingerprint Identiffcation Process" (lEICE National 

Conference on Information and Systems, No. 125 (1987), a method is disclosed for calculating the distribution of the 

number of lines present by counting the number of ridge lines passing through each scanning line. 

[0010] Kobayashi ("A Template Matching Scheme for Fingerprint Image Recognition", lEICE Technfcal Report, 

PRU91 45, pp. 25 30, July 1991)) discloses a method for comparing black pixels extracted from a thinned Image (or 
35 narrowed Image) of a registered fingerprint and the binary Image (or nan^owed image) of a test fingerprint wherein the 

processing amount and memory capacity have been decreased to a greater degree than in the process for comparing 

two binary images. 

[0011] In consideration of the conservation of memory for registered information, it is necessary to decrease the 
memory quantity as much as possible. In the present invention, it is necessary to record the narrow processed binary 

40 Image (line figures) as registered Infomiation. As a method for storing line figures, a method Is known whk:h uses 
Freeman chain codes (e.g., Yasul and Naka|ima, "image Infomiation Processing", pp. 113-114, Morikita Publishing 
(1 991 )); however, the application of this nr^ethod to complex images, as In the case of a fingerprint, is extremely diffbult. 
[0012] Conventionally, methods such as reversion of the fingerprint lines, thinning, and comparison alignment, for 
example, represent procedures with a large processing amount, at the time of comparison of the fingerprint image. In 

^ addition, in the comparison method whteh utilizes characteristic points (end points, branch points, points of intersection) 
of the image, due to reversion of the fingerprint lines, the processing amount is large, and in addition, comparison is 
diffteult In the case when the characteristic points are unclear or Indistinct, and when the number of these characteristic 
points is small. In the comparison process whk:h utilizes pattern matching of the original images of a registered finger- 
print and a test f ingeq3rint, at the time of seating, the width of the ridge lines of the fingerprint are altered due to factors 

so 8uch as the pressure of the finger, existence of a dry state, and the like, and hence, errors are easily generated and 
a large memory capacity is necessary to store the registered information. 

[0013] EP-A-0 508 845 from the same inventor describes a method and an apparatus for image processing for 
comparing fingerprints and the like. To avoid reducing the accuracy of the comparison due to the variations of the 
fingerprint lines when the fingerprint input is made, a method has been resolved wherein the line width of the registered 
^ fingerprint is narrowed more than the line width of the tested fingerprint Reduction of the throughout of recording and 
comparison is solved by the selective utilization of the input of an activated fingerprint Image, the judging of the finger- 
print boundaries and the processing of only the activated division, and, additionally. In the comparison, by midway 
abandonment, midway decision, multi-step variation of the increment, and/orlntroduction of a subtemplatejump search. 
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By Introducing the degree of discordance between two images, It beconries possible to compare two Images based on 
a comparison of the blacic pixels of the registered Image to those of the Image undergoing testing. As a result, the 
processing amount for position matching is reduced in comparison with the case when all blacic pixels of two Images 
are checlced, or the entire images, Including blacic and white pixels, are checlced. Reduction of the amount of processing 

5 required for registration and comparison is resolved by setting the blacic pixel address of the nan^owed image of the 
registered fingerprint to recorded infomiation as a subtemplate and a non subtemplate, by creating a storage fomi 
which takes Into consideration the narrowed image by means of the storage of registered infomnation, and by carrying 
out the reduction of registered data. Reduction of the throughput of nanrowization processing (Including thinning) was 
resolved by the direct detection of the centre point of a black pixel aggregation, and by a performed Judging table. 

10 [0014] An article by Wei-Chung Lin and Richard C. Dubes entitled « A Review Of Ridge Counting In Dermatoglyphics 
» (Pattern Recognition, 1983, UK, vol. 16, no. 1, ELMSFORD, NY US, pages 1-18) discloses that a fingerprint ridge 
count is the number of ridges whtoh Intersect a straight line drawn from the central point of a triradius to the center of 
a fingerprint pattern, and that the threshold Is selected to make the number of black pixels approximately equal to the 
number of white pixels in order to obtain a smoothed image by thresholding. 

15 

Summary of the Invention 



[0015] It is an objective of the present invention to provide an Image processing method and apparatus comprising 
one or more means for improving the comparison properties of a fingerprint or similar image. 

^ [0016] Said method and apparatus are more precisely defined in claim 1 and in claim 2. 

[0017] in an embodiment of the comparing method and apparatus according to the present invention, the infonnation 
(the address group of black pixels extracted from a specified range of the Image) extracted from a binary image pro* 
duced by binary converting, and thinning or narrowing a registered image, and the binary Image of a test image are 
aligned and the concordance of their black pixels are checked to judge whether or not a positive ldentifk:ation (i.e., 

S5 whether or not an individual's identity can be confirmed) can be made. 

[0018] In the following, an outline of the essential components of the image processing apparatus and method for 
the same according to the present invention will be explained. 

[0019] Increasing the comparison precision in order to improve the Image processing properties Is accomplished by 
means of selectively utilizing a means for judging whether the concordance or discordance degree meets specified 
30 conditions when the ratio of the total number of black pixels to the total pixels falls within a specified range; a means 

for checking the presence and position of a hole generated by a white pixel aggregation within a black pixel aggregation; 
a means for examining neighboring pixels when comparing binary converted images; and a means for registering the 
optimum image obtained from reciprocal comparison of one or more Images. 

[0020] Increasing the quality of the Image in order to Improve the Image processing properties Is accomplished by 
35 means of selectively utilizing a means for performing binary conversion using a threshold value whteh Is obtained by 
means of caknjlatlng the average brightness for each partial region is calculated, and converting the average brightness 
values In reciprocal intervals of the partial regions; a means for perfonning binary conversion of portions in which little 
variation of the brightness occurs; and a means for repeatedly periomrilng binary conversion in order to keep the ratio 
of the total number of black pixels to the total number of black and white pixels within a fixed range. 
40 [0021] Decreasing the processing amount for comparison In order to improve the image processing properties is 
accomplished by means of selectively utilizing a means for sequentially judging the degree of concordance at each 
partial alignment inten^al such that in the case when image concordance Is detected, the comparison process is not 
conducted for partial alignment intervals following the partial alignment interval in whteh concordance was detected; 
and a means for comparing m number of partial alignment intervals (m ^ 1 , and Is a predetemnined constant), and for 
^ detemiining discordance when the maximum degree of concordance over these intervals is less than a specified value. 
[0022] In the case when calculation of the degree of discordance during the comparison process is undesirable, 
Improvement of the image processing properties is achieved by selectively utilizing a means for using Information of 
a reversed image as reversed registered information and then comparing the registered infomiation of this reversed 
registered image, and a reversed test image. 



so 



Brief Description of the Drawings 



[0023] FIG. 1 shows a structural example of a fingerprint recognition system according to an embodiment of the 
present invention. 

S5 [0024] FIG. 2A is a diagram illustrating an an'angement of the image memory of Rg. 1 . 
[0025] FIG. 26 is a diagram illustrating an arrangement of the memory of FIG. 1 . 
[0026] FIG. 3A shows an example of 3x3 pixel aggregatton. 
[0027] FIG. 36 shows an example of 4x4 pixel aggregatton. 
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[0028] FIG. 3C shows examples of 4x3 pixel aggregations. 

[0029] FiG. 4 shows examples of the divisions of a sub-template and non*sub-template with regard to a fingerprint 
region. 

[0030] FIG. 5 is a flowchart showing an outline of a procedure IN for continuously confimiing the validity of the image 
5 input and for designating an image. 

[0031] FIG. 6 is a diagram for use In explaining the modification of a processing range of an image. 

[0032] FIG. 7 is an example of the division of an image Into partial regions; this figure Is for use In explaining the 

variation of the average brightness of a partial region. 

[0033] FIG. 8 Is a flowchart showing an outline of a binary conversion process occunring in a partial region in which 
10 there is tittle variation of the brightness. 

[0034] FIGS. 9A and 9B show an outline example of a process for standardizing the ratio of binary converted black 

pixels of a binary Image which has been divided Into partial regions. 

[0035] FIG. 10 Is an example of a table of a valid partial portion of a fingerprint. 

[0036] FIGS. 11 A and 11 B are diagran)s for use in explaining a hole (white pixel aggregation) and a non-hole re- 
is spe^ively. 

[0037] FIGS. 12A. 128, 12C and 12D are diagrams for use In explaining the change from a memory fonmt to a 

compression format of a binary image. 

[0038] FIGS. 1 3A and 1 38 depict a flowchart showing an outline of a comparison process based on procedure C. 
[0039] FIG. 14 is a diagram for use in explaining a method for checking discordant portions in a comparison process. 
20 [0040] FIG. 1 5 Is a flowchart showing an outline of an auxiliary procedure (procedure W) for checking the concordance 
of images in a comparison process. 

[0041] FIG. 16A is a diagram illustrating an example of the neighboring pixels search in the comparison process. 
[0042] FIG. 1 68 is a flowchart of the reciprocal relationship of concordance and approximate concordance. 
[0043] FIG. 1 7 is a flowchart showing an outline of the fingerprint registration and comparison processes. 
25 [0044] FIG. 1 8 Is a flowchart showing an outline of a registration process wherein the optimum registered fingerprint 
from among a plurality of input images is selected. 

[0045] FIG, 1 9A is a diagram showing a comparison relationship between one test fingerprint and N registered fin- 
gerprints. 

[0046] FIG. 198 is a flowchart of the comparison of the one test fingerprint against the N registered fingerprints 
30 shown In FIG. 19A. FIG. 20A is a flowchart of the registration process when using a white/black reversed image. 
[0047] FIG. 208 Is a flowchart of the comparison process when using a white/black reversed Image. 

Detailed Description of the Preferred Embodiments 

^ [0048] In the embodiments of the present invention, the case in whtoh a fingerprint (also refen^ed to hereafter as 
"fingerprint image") Is used as the image is presented. FIG. 1 shows a structural example of a fingerprint Identification 
system. The fingerprint input from Image input unit 2 is processed In Image processing unit 1 . image processing unit 
1 comprises image memory 4 for storing a gray-scale image, a binary Image, and various processed Images of the 
digitalized fingerprint; central processing unit 5 fonned from at least one CPU; and memory 6 for recording information 

^ such as progranf)s, data, data collections, and the like. In the case when a special recording unit is included in memory 
6 (e.g., semi-conductor memory, magnetk: disc or the like), during mutual intervals, the movement of information is 
perfomied when necessary by means of hardware and/or software. 

[0049] Image memory 4 and memory 6 are classified according to the stored information, however, it is also possible 
to Incorporate both of these memories Into the same recording unit. Image Input unit 2 comprises an Image pick-up 

^ unit 7. A/D converter 3 converts analog Infomiation into digital infomiatlon (in tlie case when various Image input units 
whteh can directly receive digital image are used, an A/D converter is unnecessary). The pixel address in image memory 
4 for storing fingerprint images (gray-scale images of digitalized fingerprints) Is represented by means of X and Y 
coordinates (X,Y). Pixel address p<,Y) may be Indicated by "pixel (X,Y)" or simply "p(,Y)". The portion of Image memory 
4 storing a single image Is refemed to as "image plane". Image memory 4 may hold at least one image plane. In addition, 

50 pixel address may also be referred to as simply "address". 

[0050] Each image plane In Image memory 4 Is constructed of image pixels, and when the domains of ail of the pixel 
addresses are set to 0 ^ X ^ Xh and 0 ^ Y ^ Yh, the processing domain specified in the domain these pixel addresses 
is processed. In the case when a number with a decimal Is generated for the pixel address or the number of pixels by 
means pf cateulating the sum of the pixel addresses and the number of pbceis, processing Is perfonned by rounding 

55 of these numbers (i.e. , 4 or less, round down; 5 or greater, round up to nearest integer). The value of a pixel is expressed 
by its brightness. The portion of the brightness defining a ridge depends upon the processing of an Image in image 
processing unit 1 , and upon the processing method of Image input unit 2. In both cases, processing Is possible by 
means of presetting brightness characteristics con-esponding to ridges Into Image processing unit 1 . 
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[0051] An aggregation of one or more pixels is referred to as "pixel aggregation", tn fingerprint recognition, the fin- 
gerprint which is inputted from image input unit 2 for entry Into menfK)ry 6 of image processing unit 1 1s referred to as 
"registered fingerprint", and the fingerprint which is inputted from image Input unit 2 for testing is referred to as "test 
fingerprinr. in an image which has been binary converted into black and white pixels, either the biaclc pixels or the 

s white pixels may be selected as the objective pixel corresponding to the ridge lines or trough lines of a fingerprint, in 
embodiments of the present invention, the fingerprint lines will be comprised of black pixels. 
[0052] Thinning is a process in which the majority portion of a line width is set to equal one pixel. However, in the 
embodiments of the present Invention, the partial or entire nanx)wlng of the line widths of a black pUel aggregation so 
that they are included in an image formed by means of the black pixels of an original binary image will be referred to 

^0 as "narrowing process^ Accordingly, an image obtained as a result of this nan'owing process will be referred to as 
"narrowed Image". In the embodiments of the present Invention, thinning is one type of narrowing process. Furthemiore, 
a line width is defined as the shortest distance (number of pixels) required to travel from a random point on the margin 
of one line to the opposite margin of the same line, passing through the inner portion of the line. Hence, a line width 
can be set for each margin position of a line. 

15 [0053] FIG. 2A shows the state of the Image data stored in image memory 4. Digltallzed Images (binary images or 
gray-scaie images) obtained from the image inputted from image input unit 2 are stored in the image planes of image 
10. in the Image planes of image 11, for example, images at the time of input are stored, and can be utilized in the 
processing of Image 10. Depending on the selection of the processing procedure, Image 11 may be unnecessary (In 
this case, it is possible for memory 4 to utilize only image 10). It Is also possible to conduct image processing using 

20 memory 6 by transfemng an image from image memory 4 to memory 6. FIG. 2B shows the state of data stored In 
memory 6. Program and data 1 2 store the programs and data for use in achieving the embodiments of the present 
Invention, while registered information 13 places and maintains the registered Infonnation of a registered fingerprint 
Image in a file. 

[0054] With regard to the pixels of an image, a value corresponding to the brightness therein is defined. The bright- 
25 ness of a pixel address (X.Y) is indicated by f (X,Y). Depending on the method of image input, a gray-scale image 
designated by image memory 4 may be produced by means of binary conversion, or a binary image may be directly 
designated by image memory 4. A gray-scale image is an image in whrch various brightness values exists; this variable 
region of brightness can be applied to random gray-scale Images as an objective of the present Invention. However, 
for sake of convenience, In the embodiments of the present invention, in the case when numerical values are mentbned, 
so the brightness will vary between 0 and 255, with 0 representing the lowest brightness level (black), and 255 representing 
the highest brightness level (white). Intennedlate values therein represent successive values of the brightness between 
black and white. 

[0055] A binary image is expressed by means of black pixels and white pixels only, and the values corresponding 
to the brightness of these respective black and white pixels are defined. The selection of black pixels to represent 

35 sections of a high brightness or sections of a low brightness is detennlned by the desired image and method of Input; 
in the embodiments of the present invention, either case is possible, in the following, In the case when consideration 
must be given to values of brightness (e.g.. In the case when stating values relating to the brightness), with regard to 
binary images, the brightness of a black pixel is 0, and the brightness of a white pixel is 255. 
[0056] The theoretical origin and coordinate axes of an image stored in image memory 4 may be independently 

40 defined as the position of a pixel of a physical image memory 4. The X and Y axes may be randomly designated, 
however, for the sake of convenience, the X-axis possesses a horizontal orientation from left to right (i.e., in the direction 
of Increasing value X), and the Y-axis possesses a vertical orientatton from top to bottom (i.e., in the directton of In- 
creasing value Y). 

[0057] An aggregation of at least one pixel Is refenred to as "pixel aggregation". FIG. 3 (a) Is a pixel aggregation 
45 fomried from pixels arranged in 3 x 3 pixels (i.e., 3 pixels x 3 pixels); FIG. 3 (b) is a pixel aggregation fonmed from pixels 
arranged in 4 x 4 pixels; and FIG. 3C is a pixel aggregation fomried from pixels an^anged in 4 x 3 pixels, in FIG. 3A, 
pixels {P^, P3, P5, P7} represent the 4-neighbor connected pixels of Pq; pixels {P^, Pg, P3, P4, P5, Pg, P7, Pg) represent 
the 8-neighbor connected pixels of Pq. 

[0058] in the embodiments of the present invention, division is performed only when the denominator is not zero. 
so [0059] Notations and definitions used hereafter will be defined below. Some of these notations, however, may not 
appear in the embodiments. 

[m]: Indk:ates the rounding down of an optional number m. 

11: Indicates a connection of two numbers of the values shown (e. 

S5 g, 1 liOlil =101). 

-^i Indteates the range between two numbers (e.g., a ~ b indicates 

the range between a and b whtoh includes both a and b). 
f (X,Y): Indteates the brightness of pixel address (X,Y). 
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Fingerprint region; the area Inside of this fingerprint region is 
considered the fingerprint boundary. 
Address of the approximate center point of a fingerprint. 
Address of the approximate center point of a registered finger- 
print. 

Address of the approximate center point of a test fingerprint. 
Modified image of a registered fingerprint produced by perfomn- 
ing at least the nanrowing process on the binary image (first 
image) of a registered fingerprint obtained from a registered 
fingerprint image (gray-scaie Image or binary Image), 
Modified image of a test fingerprint produced by means of ad- 
Justing the ratio of the biacic pixels and/or perfomiing a narrow- 
ing process on the binary image (second image) of a test fin- 
gerprint obtained from a test fingerprint Image (gray-scale im- 
age or binary Image). 

Aggregation of all address (X,Y) of blacic pixels within the fin- 
gerprint region of the modified image Rth of a registered finger- 
print; RA is the sum aggregation of Rr(0), RB(0), and blacic 
pixels within the unused portion of a fingerprint region. 
RT(0) is a partial aggregation of RA; RT(0) may designate a 
sub-region of RA in which at least one randomly separated re- 
gions of the pixel aggregation exist; RT(0) Is referred to as "sub- 
template"; the portion of an image which extracts the sub-tem- 
plate Is often referred to as "sub-template portion"; the sub-tem- 
plate is used in the aligning of images (see FIG. 4). 
RB(0) is a partial aggregation of RA which may designate a 
sub-region of RA one or more randomly separated regions of 
the pixel aggregation; RB(0) Is refen-ed to as "non-sub-tem- 
piate"; the portion of an image which extracts the non-sub-tem- 
plate is often referred to as "non-sub-tempiate portion"; the sub- 
template Is not used In the aligning of images. iTr(O) and RB 
(0) are designated such that they do not overiap (see FIG. 4). 
The aggregation of biacl< pixel addresses (X, Y) of sub-template 
RT(0) at the time when the coordinate axes of the modified im- 
age of the registered fingerprint is rotated S degrees (S*) 
around a randomly defined center point. 
The aggregation of addresses of sub-template RT(0) In the co- 
ordinate axes following rotation of the coordinate axes of 
the modified image of the registered fingerprint around a ran- 
domly defined center point (e.g., the approximate center point 
of a registered fingerprint), as well as, after conducting horizon- 
tal displacement H and vertical displacement V; RT(0, 0, 0) = 
RT(0) and RT(S, 0, 0) = RT(S); (further, one pattern which is 
displaced by means of coordinate conversion of the modified 
image of a registered fingerprint is defined by means of the val- 
ues of set {S, H, V} which designates a displacement position.). 
The aggregation of addresses of non-sub-template RB(0) in the 
coordinate axes following rotation of the coordinate axes of 
the modified image of the registered fingerprint around a ran- 
domly defined center point (e.g., the approximate center point 
of a registered fingerprint), as well as, afterconducting horizon- 
tal displacement H and vertical displacement V; RB(0, 0, 0) = 
RB(0) and RB(S, 0, 0) = RB(S). 

The number of concordant black pixels of the sub-template; In- 
dicates the number of concordant blacic pixels between the 
sub-template of the modified image of the registered fingerprint 
and the modified image of the test fingerprint. 
The total number of blacic pixels of the sub-template; indicates 
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15 



20 



25 



N2m: 



N2c: 



10 Nm: 
Nc: 



Partial region: 
Interval [a, b]: 
Alignment interval: 

Partial alignment Interval: 
Displacement position: 



30 Registered fingerprint (registered image): 

Test fingerprint (test Image): 
Threshold value: 



35 



the total number of black pixels in the sub-template of the mod- 
ified image of the registered fingerprint. 
The number of concordant black pixels of the non-sub-tem- 
plate; Indicates the number of concordant black pixels between 
the non-sub-template of the modified Image of the registered 
fingerprint and the modified image of the test fingerprint. 
The total number of black pixels of the non-sub-template; indi- 
cates the total number of black pixels in the non-sub-template 
of the modified image of the registered fingerprint. 
Indicates N1 m or N2m; Counter Nm Is the value of the counter 
in the cak:uIation of Nm. 

Indicates NIc or N2c; Counter Nc is the value of the counter in 
the calculation of Nc. 

The individual regions which result from the division of an im- 
age into a plurality of parts. 

Indicates the interval between two optional values, a and b, 
which includes both a and b. 

Indicates the range over which an image is displaced in order 
to align two images (group of displacement intervals for each 
direction), and is constructed from {rotational displacement in- 
terval, horizontal displacement interval, vertical displacement 
Interval}. 

The individual alignment intervals resulting from division of an 
alignment interval into at least one partial group; the entire 
alignment interval Is the aggregate sum of at least one partial 
alignment interval. 

Position expressed by one group {rotational displacement po- 
sition, horizontal displacement position, vertical displacement 
position}. 

Registered fingerprint image or modified image of a registered 
fingerprint. 

Test fingerprint Image or modified Image of a test fingerprint. 
A constant value for use in making Judgments using the ratio 
of an evaluation value to a threshold value; the method for de- 
fining a threshold value differs for each evaluation value. 



[0060] FIG. 4 shows an example of the relationship of a fingerprint region defined by means of a fingerprint boundary 
to the portion for extracting sub-template RT(0) and to the portion for extracting non-sub-template RB(0), in image 10 
of image memory 4. Examples 1 - 3 are examples of the sub-template and non-sub-template portions. 

40 [0061] In the following, the procedure for processing a fingerprint Image will be explained. Further, with regard to 
each step of the procedure, in the case when the subsequent process is not mentioned, the procedure progresses to 
the subsequent step. The constants used in each step take into consideration the various conditions of Image process- 
ing unit 1 and image input unit 2, and designate statically or dynamically appropriate value. The realization of each 
step as well as the processes linked therein, may be modified provided that the contents of the processing remain the 

^ same. 

(1) Means for designating a Fixed Moment of Input from image Input Unit to Image Memory 

[00621 Image 1 0 which is Inputted from Image input unit 2 to image memory 4 varies according to the movement the 
so object of Image pick-up unit 7 (i.e., In the case when the object is a fingerprint, a finger is put on image input unit 2). 
As a result, it is necessary to define the moment which designates image 10 of image memory 4. This processing 
method comprises: 

(a) A method for recognizing the fixed moment of an Image by means of a signal sent from Image Input unit 2 to 
55 image processing unit 1 ; 

(b) A designating method by means of which a user designates the fixed moment of an image to image processing 
unit 1; or 

(c) A defining method by means of which Image processing unit 1 defines the fixed moment of an bnage by means 
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of checking the state of image 1 0 of image memory 4. 
[0063] in the following, an example of method (c) will be provided. 

[0064] When the gray-scale Image of a fingerprint has been correctly Inputted, the average brightness value lies 
5 within a fixed range, and when this state continues, a stable image can be obtained. Utilizing this aspect, In order to 
increase the quality of the image defining this input, the average brightness value of a previously defined pixel aggre- 
gation of the Image (e.g., the entire region of the image or one or more partial regions) is calculated. When this average 
brightness meets specific conditions, the aforementioned image is Judged to be a valid image, and when this process 
Is continued such that the number of valid images recognized exceeds a specified number, the last image of Image 
10 memory 4 which Is temporarily fixed Is designated. 

[0065] Based on the aforementioned, an example of the designating method for designating the fixed moment of 
image Input is shown in procedure IN. 

(Procedure IN) 

15 

[0066] 

Step INI: 

Counter Fa is reset to "0". 
20 Step IN2: 

The image input process is commenced, and image of the image memory is temporarily fixed. 
Step IN3: 

Within a specified region of the image, the average brightness E^v of this specified region is calculated, and 
when this average brightness of this specified region meets certain conditions, the Image is Judged to be valid, 
2s and the procedure moves to step IN4. If the average brightness does not meet the aforementioned conditions, the 
image is judged to be Invalid, and the procedure returns step INI . 

Average brightness E^^ of a specified region = 

so 

(Sum of brightness of pixels within the specified region) / (total number of pixel within the specified region) 

wherein El < E^^ < E^; El and E^ are constants which are defined taldng Into consideration the variable 
region of brightness in the case when the image to be processed is inputted. 
35 Furthemiore, In the case when a pluraHty of specified regions exist, the average brightness of the speciried 

regions is checked against the specified conditions for each region . and when the number of valid specified regtons 
exceeds a certain threshold value, the Image Is judged to be valid. 
Step 1N4: 

" 1" is added to counter Fa. 
40 Step m: 

Fa is checked as to whether or not it has reached a specified value Fat; In the case when Fa has reached a 
specified value Fat, the procedure moves to step IN6. In the case when Fa has not reached this specified value, 
the procedure retums to step 1N2. The value of constant Fat Is designated according to the shortest nunnber of 
cycles required for the Inputted Image to be stabilized. 
45 Step INS: 

The image of image memory is designated (end of procedure IN). 

FIG. 5 is an outline showing the flow of procedure IN for designating an Image by means of continuous rec- 
ognition of the input and validity of the Image. 

so (2) Image Modifying Means 

[0067] The properties of the Image inputted from Image input unit 2 to image processing unit 1 can be Improved 
more effectively by using a smaller number of pixels In the processing over a range In whteh the recognition precision 
remains the same. For example, In the case when the number of pixels of the Innage memory Is larger than the number 
55 of pixels to be processed (e.g., when the number of pixels of image memory 4 is 640 x 480 pixels (X = 0 - 639, Y = 
0 479), and the number of pixels to be processed is 256 x 240 pixels (X = 0 255, Y = 0 239)), after the Image 
Is inputted Into Image nf^emory 4, the range of the Image corresponding to the input is checked, and a partial aggregation 
of the image is extracted as a provisional image. Furthermore, from this provisional image, a small Image corresponding 
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to the required number of pixels for processing is extracted, and this small image is then converted Into a normal Image 
for processing. An example of this Image modifying means is shown by procedure ET 

(Image modifying procedure ET) 

5 

Step ET1 (Extraction of the small Image In the X-dlrection): 

[0068] Steps ET1 a ~ ET1 d are executed. 

10 Step ETIa (Determination of the X-coordinate of the left margin of the provisional (mage possessing a black pixel): 

[0069] Ka represents the increasing width In the X-direction (e.g., Ka = 1); the following process Is conducted until 
the left margin of the provisional Image is found wherein u = 0, Ka, 2Ka, 3Ka, ... (In order). 

[0070] The total value GA (u) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja, ... ) which is extracted In the Y- 
is direction at the time when Y = u Is calculated, and the value of u, at the time when the existence of a brightness 
corresponding to a black provisional image Is Initially conflmied, is designated as the X-coordinate of the left margin 
of the provisional Image. For example, In the case when the image possesses only high brightness values in a state 
when there is no Image input, and If Ja represents Increasing width in the Y*direction (e.g., Ja = 1), the value of u at 
the time when it is confirmed that GA (u) < GA, is designated as the X-coordinate of the left margin of the provisional 
20 innage (note: it is also possible to add the conditions of GA (u 4- Ka) < GA In order to further increase the reliability of 
the aforementioned). Constant GA is the threshold value indicating that a black provisional image Is present at the 
time of binary conversion; the total brightness value of provisional extracted in the Y-directlon is defined by taking into 
consideration the brightness value wherein this value approaches a minimum value at the time when black provisional 
Images are incorporated. 

25 

Step ET1 b (Detemnination of the X-coordlnate of the right margin of the provisional Image possessing a black pn>vlslonai 

image): 

[0071 ] The following process Is conducted until the left maiigin of the provisional image is found wherein v = Xh, Xh 

30 . Ka, Xh - 2Ka. Xh - 3Ka, ... (In order). 

[0072] The total value GA (v) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja, ... ) whteh Is extracted in the Y- 
direction at the time when X = v is calculated, and the value of v, at the time when the existence of a brightness 
corresponding to a black provisional image Is initially confinmed, is designated as the X-coordinate of the right margin 
of the provisional Image. For example, if Ja represents increasing width In the Y-direction (e.g. , Ja = 1 ), the value of v 

35 at the time when it Is confirmed that GA (v) < G A, Is designated as the X-coordinate of the right margin of the provisional 
Image (note: It is also possible to add the conditions of GA (v -i- Ka) < GA in order to further increase the reliability of 
the aforementioned). 

Step ETIc (Detennination of Wx of the X-coordinate of the center point between the left and right margins of the 
40 provisional Image): 

[0073] The Wx of the X-coordinate of the center point between the left and right margins of the provisional image Is 
determined by the following fomiula. 

45 

Wx = (u + v)/2 

Step ET1 d (Determination of the initial X-coordinate for extraction of the small Image): 
so [0074] The Initial X-coordinate Xa of the small image is determined by the following formula. 

Xa = Wx-XL/2 

55 [0075] XL represents the number of provisional in the X-directlon of the small Image. In order to standardize the size 
of the small image region, tiie following equations are fonned: 

when 
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Xa<0,Xa = 0; 

and 

5 when 

Xa4^X1 -1 >Xh,Xa=:Xh-XL 

io Step ET2 (Extraction of the Y-directionaf range of the small Image): 

[0076] In step ET2a ET2d, the same processes as In step ET1 are conducted with regard to the Y-dlrectlon In 
order to calculate the Y-coordlnate range of the small image. 

IS Step ET2a (Determination of the Y-coordinate of the upper margin of the provisional image possessing a black 
provisional Image): 

[0077] Kb represents increasing width in the Y-direction (e.g., Kb = 1); the following process Is conducted until the 
upper margin of the provisional image Is found wherein u = 0, Kb, 2Kb, 3Kb,... (in order). 

20 [0078] The total value GB (u) of the brightness of the X-coordinate (Y = 0, Jb, 2Jb, ...) which is extracted In the X- 
direction at the time when Y = u is calculated, and the value of u, at the time when the existence of a brightness 
corresponding to a blacic provisional image Is Initially confimied, is designated as the Y-coordinate of the upper margin 
of the provisional image. For example, In the case when the image possesses only high brightness values In a state 
when there Is no image input, and if Jb represents Increasing width in the Y-direction (e.g., Ja - 1), the value of u at 

2s the time when it is confinmed that GB (u) < GB, is designated as the Y-coordinate of the upper margin of the provisional 
image (note: it is also possible to add the conditions of GB (u + Kb) < GB in order to further increase the reliability of 
the aforementioned). Constant GB is the threshold value indicating that a blacl( provisional image is present at the 
time of binary conversion; the total value of the brightness values of provisional image extracted in the X-direction is 
defined by talcing into consideration the brightness values wherein this value approaches a minimum value at the time 

30 when black provisional are incorporated. 

Step ET2b (Determination of the Y-coordinate of the lower margin of the provisional image possessing a black 
provisional Image): 

35 [0079] The following process Is conducted until the left margin of the provisional image Is found wherein v = Yh, Yh 
- Kb, Yh - 2Kb, Yh - 3Kb. ... (in order). 

[0080] The total value GB (v) of the brightness of the X-coordlnate (X = 0, Jb, 2Jb, ...) which is extracted In the X- 
direction at the time when Y = v is calculated, and the value of v, at the time when the existence of a brightness 
corresponding to a black provisional image is initially confinned, is designated as the Y-coordinate of the lower margin 
40 of the provisional image. For example, if Jb represents increasing width in the Y-direction (e.g., Ja = 1 ), the value of v 
at the time when it is confirmed that GB (v) < GB, Is designated as the Y-coordinate of the lower margin of the provisional 
iniage (note: It Is also possible to add the conditions of GB (v - Kb) < GB in order to further Increase the reliability of 
the aforementioned). 

45 Step ET2c (Detemiination of Wy of the Y-coordinate of the center point between the upper and lower margins of the 
provisional Image): 

[0081 ] The Wy of the Y-coordin ate of the center point between the upper and tower margins of the provisional Image 
is detennined by the following formula. 

so 

Wy=(u + v)/2 

Step ET2d (Detemnination of the initial Y-coordinate for extraction of the small Image): 

55 

[0082] The initial Y-coordinate Yb of the small Image is detemnined by the following formula. 
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Yb = Wy-YL/2 

[0083] YL represents the number of pixels in the Y-directlon of the small image. In order to standardize the size of 
the small image region, the following equations are fomied: 

when Yb < 0, Yb = 0; and 

when Yb + YL- 1 > Yh, Yb = Yh - YL 

Step ET3 (Extraction of the pixels to be processed): 

[0084] The range defined by X = Xa - Xa + XL - 1 , and Y = Yb - Yb + YL - 1 is then converted into a small image 
for processing. 

Step ET4 (Conversion of the small image into a nomdal image): 

[0085] The conversion for converting the range of the small image into a normal image is perfonned as necessary; 
e.g., conversion of the designation of the origin, designated location of the image, etc. (End of Procedure ET) 
[0086] FIG. 6 is a diagram for use in explaining the conversion of the processing range of an image; this figure shows 
examples of the image: designated by image memory, provisional image and small Image. Furthermore, it is also 
possible to execute procedure ET in only the X-direction or the Y-direction; in this case, the direction In which procedure 
ET is not being perfonmed serves as a fixed range, in the case when the image of image memory is used as the Image 
for processing, conversion by means of procedure ET is unnecessary. 

(3) Smoothing IMeans 

[0087] Smoothing is a process for reducing the noise of a fingerprint image. As this smoothing process, any conven- 
tional method may be employed (e.g., use of a local summation averaging filter which utiiizes the values of neighboring 
pixels around each pixel). 

[0088] In the case when a binary image can be directly inputted Into image memory 4, smoothing may be omitted. 
A gray-scale Image results from the smoothing of a binary image, thus it is necessary to conduct binary conversion of 
this image after smoothing. 

(4) Binary Conversion and Baclcground Segregation Means: 

[0089] Binary conversion is a process forconverting a gray-scale Image into a binary Image. Background segregation 
is a process for clarifying the valid range of a fingerprint image of image 10 In image memory 4. In the following, 
procedure B will be presented as an example of a procedure for conducting binary conversion and background sepa- 
ration. The input Information Is the Input Image infomiation. The output information of procedure B is the binary image 
of the output image and the fingerprint boundary information. In the case when utilizing an image input unit which can 
dlre^ input the binary image into image memory 4, binary converston (step 81) is omitted, and only background 
segregation Is performed. Slmilariy, In the case when only binary conversion is required, i.e., background segregatton 
Is unnecessary, it is possible to only perfonn step B1 . 

(Procedure B) 

[0090] K is defined as a constant indicating the X-directionai length of a partial region. The Y-directional length of a 
partial region may differ from the X-directlonal length of the partial region, however, for the sake of convenience, the 
case In which these lengths are equal will be presented In the following. In addition, L is defined as follows: 

L=(Xh + 1)/K 

In the formula, K is selected to produce an integer L. in general, it is possible to vary the length of each partial regton. 

K„«x=((Xh+1)/K).1 

With regard to Image 10, the partial region addresses, whteh uniquely and clearly discriminate each partial region, are 
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designated as initial pixei addresses for each partial region. A random pixel address (X,Y), at partial region address J 
(M,N), Is M =[X/K1, and N =[Y/K]. Accordingly, pixel address (X,Y) corresponding to partial region address J(M, N) Is 
obtained by, perfonning the following calculations: 

X = K*M.(M=0.1.2 K^) 

Y=K*N.{N=0J.2 K„^) 

Step B1 (binary conversion): 
Step Bla : 

[0091 1 Processing is performed with regard to the following: 

M = 0, 1 , 2 , K„|gjj 

N=0.1,2 .K^ 

The average brightness B^y(M, N) of ail of the pixels within each partial region is obtained for each partial region J(M, 
N) using the following equation: 

Bav(M, N)=: (the sum of the brightness values of the pixels within a partial 
region) / (the number of pixels within the partial region) 

At this point. (M. N) of 

X = K.M(M = 0-^K^) 

Y = K*N(N = 0^K„3,) 
corresponds to the range of Image 10, In other words, when the range of the Image are 

O^X^Xh 

O^Y^Yh 

the corresponding range becomes 

IVI = 0-pCh/KJ 
N = 0 [Yh/K) 

and, 

total number of partial regions in Image 10 = (pCh/KJ + 1) • ([Yh/K] + 1). 
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In addition, the average brightness of the entire image is obtained as foiiows. 

Average brightness of the entire image = 
(Sum of brightness vaiues of the entire image) / (Totai number of pixeis In the entire image). 

Step Bib : 

[0092] In order to reduce the non-continuity generated by the boundaries of the partial regions, the following modi- 
fications are carried out when 

M=1 --(P(h/KJ-1) 



N=1 -{[Yh/K)-1).then 



Cav(M. N) = (AO • Bav(M. N) A1 • Bav(M'i-1 , N) + A2 • 
Bav(M4'1. N-1) + A3 • Bav(M. N-1) 4- A4 • Bav(M-1 . N-1) + AS • 
Bav(M-1 , N) + A6 • Bav(M-1 , N+1 ) + A7 ♦ Bav(M, N+1) + A8 • 
Bav(M+1, N+1))/ (AO + A1 + A2 + A3 + A4 + AS + A6 + A7 + AS). 

AO, A1 , A2, A3, A4, AS, A6, A7 and A8 are constants which are detennined by taking into consideration the reciprocal 
relationships between partial regions. For example, It is possible to set the following: 

AO = A1 = A2 = A3 = A4 = AS = A6 = A7 = AB = 1 The Cav{M, N) of each (M, N) is then stored In the working 
area of memory. 

[0093] Subsequently, it is also possible to change the average brightness Bav(M, N) of each partial region according 
to the reciprocal relationships between the partial regions (M. N) by means of setting Bav(M, N) - Cav(M, N) for 

M = 1 - (P(h/Kl-1)andN = 1 -([Yh/K]-1). 

[0094] FIG. 7 shows an example of the relationship between a partial region (M, N) and the average brightness Bav 
(M, N) of this partial region. The method for modifying the average brightness of the partial regions according to the 
reciprocal relationships of the partial regions Is not limited to just the aforementioned processes. For example. It is 
possible to increase or decrease the number of partial regions, as well as change the formula of the above-mentioned 
Cav(M, N) using the reciprocal relationships. 

Step Bic : 

[0095] (a) The threshold value T with regard to the brightness f (X,Y) of pixel (X, Y) of the partial region for which B^y 
(X,Y) was calculated with respect to each partial region is set as follows: 

T== average value of brightness of a partial region + D -i- Da 

wherein D is a constant for correcting the average brightness value of the partial region. Da is a variable (e.g., initially, 
Da = 0) whteh will be explained hereafter. 

[0096] When f(X,Y) ^ T. (X.Y) for this partial region (M.N), i.e.. the (X.Y) of the region defined by 

K*M^X^K«(M + 1)-1 
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K»N^ Y^K»(N + 1).1 



designates white pixels (however, when reversing the pixels, (X,Y) designates black pixels); while, on the other hand, 
5 when f(X,Y) < T, the (X.Y) designates black pixels (when reversing the pixels, (X.Y) is set to white pixels). 

[0097] As described In the aforementioned, a binary conversion process is provided In which the average brightness 
values of the partial regions serve as essential components of the threshold value. 

[0098] When a large number of pixels with high brightness values exist within a partial region, and when the average 
brightness values of partial regions In whteh little brightness variation occurs are high, a large number of pixels within 
10 a given partial region will be converted to black pixels as a result of binary conversion. In order to prevent this afore- 
mentioned result, partial regions possessing a high average brightness, in which there is little brightness variation, 
undergo binary conversion using a specified threshold value whtoh Is previously defined, rather than employing the 
aforementioned binary conversion threshold value. In the following, a concrete procedure for performing the aforemen- 
tioned will be explained. 

15 [0099] At every partial region of the original image (gray-scale Image), when Bg^{; •) s Bn,, the above-described 
binary conversion In whk;h the average brightness serves as the threshold value Is employed. 
[0100] However, when B^{\ •) ^ Bp,, 

(B„ is a value for judging whether or not the average brightness Is a high value; e.g., in the case when a brightness 
of 180 255 Is regarded as high, B^, = 180) the following calculation Is perfonmed for each pixel within one random 
20 partial region: 

G = l(average brightness of the partial region) - (brightness of each pixel within the partial region)l 

25 [0101] The maximum value G^a^ ^®se values of G Is then calculated, and In the case when G^a^ ^ ^smaR (Bsmaii 
represents the upper limit of change in the range of the brightness; e.g., In the case when change of brightness ranges 
from 0 - 10, a minute variation in brightness may be indicated by Bgn^aii = 10). the pixels of the above partial region 
are regarded as showing little variation in brightness, and hence this partial region undergoes binary conversion using 
a, specified binary conversion threshold value T = Bg (e.g., Bg represents the average brightness of the entire Image 

30 or a fixed value). 

[0102] This procedure is repeated for all partial regions of the original image. FIG. 8 is a flowchart showing an outline 
example of the binary conversion process perfonned on partial regions in which there is little brightness variation. 
[0103] In the following process, the brightness states of the image differ depending on the conditions at the time of 
image input. Therefore, the ratio of black pixels of the partial region to total pixels is first calculated, and when this 
35 value falls outside of a specified range, the value of Da is modified, and binary conversion is repeated a specified 
number of times (at least once). The procedure for optimizing the threshold value of the binary conversion will be 
presented in the following. 

[0104] The ratio of black pixels in all valid partial regions Is calculated as follows: 

40 

= (Number of black pixels in all partial regions) / (Total number of pixels In all partial regions) 



[0105] When 5 R^^ <, Rbw2, the ratio of black pixels is normal, and binary conversion can then be completed. 
However, when > H^y^, T is reduced in order to decrease the number of black pixels. In other words, Is replaced 
by (Da - Dal). When < , T is increased in order to increase the number of black pixels, i.e., Da is replaced with 
(Da + Dai). 

[0106] Rbw^ and are constants for standardizing the ratio of black pixels: e.g., when a black pixel ratio of 40 
45% is desired, R^^^ and B^ are set to 0.40 and 0.45, respectively, Dai a constant for increasing/decreasing the 
threshold value of the binary conversion (e.g., Dai = 1 ). When the ratio of black pixels is calculated using binary con- 
version, and this ratio falls outside of a specified range, the threshold value T of the binary conversion is modified, and 
the binary conversion process Is repeated a specified number of times. When the ratio of black pixels remains outside 
of a specified range even after repeating the binary conversion process a specified number of times, the procedure 
may be abandoned, for example, and then restarted from the input of the image. 

[0107] Dal reduce the processing time in order to allow .for the ratio of black pixels to fail within a specified 
range, and may also utilize a plurality of different values in order to increase the probability of the ratio of black pixels 
falling within a specified range. With regard to the binary vnage dh^ided into partial regions, FIGS 9A and 9B show an 
example of the process for standardizing the ratio of binary converted black pixels. The constant group consisting of 
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Dai. and 0^3 (e.g., D^^ = 3, = 2, and Dga = 1) Is used for modifying Da- Da, (I = 1 , 2, ...) can be structured using 
an optional number of constants. By means of designating an appropriate number of constant groups and values, the 
possibility and convergence speed of converging the value of R^^ to within a specified range can be improved. Fur- 
thennore, In FIG. 9A and 9B A^p, A^p, A^, A^^,. fi^ ^® parameters which change dynamically during the 

s processing in order to select the procedures involved. 

Step B2 (Indication of a valid partial region): 

[0108] The average brightness of the partial region is then re-calculated with respect to the binary image obtained 
10 as a result of step B1 . Next, for 

Partial region address l,^|^= (P(/K],[Y/K|) 
15 [0109] (The partial region address is the initial address of each partial region) 

X=K*IW,(iVI= 0.1,2, ...K^) 



Y = K*N, (N= 0.1,2. ...K^) 

a judgment of "valid" or "invalid" Is rendered for each partial region according to the average brightness value Bay(X, 
Y) calculated from the process for calculating the average brightness for each partial region. In other words, in a partial 
25 region where 6L ^ B^yCX.Y) ^ B^. this partial region is Judged to be a valid partial region, and valid indicator is designated 
in partial region table Y(M,N). 

Y(M,N) = {1 : Valid partial region. 0: Invalid partial region} 
[01 10] 6|_ and Bh are constants for classifying valid and invalid partial regions. 

30 Step 83 (Examination of the number of valid partial regions) 

[0111] From Y(iy4,N), 

YT = number of valid partial regions 
is counted. When YT ^ YC (e.g., YC = the total number of partial regions x threshold ratio constant), the procedure 
35 moves to step B4. When YT < YC, the a shortage in the number of valid partial regions has occurred, and hence 
present procedure ends due to an error. 

StepB4 (Left margin of the fingerprint boundary of a partial region unit): 

40 [0112] The information of the fingerprint boundaries of a partial region is represented by {(My, M^, Mr), N^^ 0 ^ 
Kmax). For each N-Hj value, ^ M ^ Mr Is the fingerprint area of the partial region unit. 
[01 13] In this step, the left margin M^^ of the fingerprint boundary is calculated for the each partial region unit. Starting 
from N=0, the following process is canied out for N=Ny, (Nj = 0 - K^ax)- Beginning from the left margin (M=0) and 
continuing In the direction of increasing M, a search Is sequentially conducted for elements G(M,N) possessing an 

45 Indicator of "1 " (indicating an valid partial region) in table G, which shows the valid partial regions. The value M^ of the 
initial M of a section in which indicators having a "1". value are continuous for Kq (Kq is a constant ^ 1 forjudging the 
fingerprint boundaries of the partial region) indicators or more is set as the left margin of the fingerprint area. At M = 
0 Kfnax* when indicators having a value of "1 " (indicating a valid partial region) are not found to be continuous for 
Indicators or more, the value of the current N is the non fingerprint area for all M. Additionally, at Hj- of the non fingerprint 

so area, 

Ml = Mr = -1. 

55 StepBS (Right margin of the fingerprint boundary for each partial region): 

[0114] In this step, the right margin Mr of the fingerprint boundary is calculated for each partial region unit. Starting 
from N = 0, f or N = (hfr = 0 - K^, any N for which the left margin was not set In step B4 (I.e., N when M^ -1 ) Is 
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skipped. Beginning from the left margin (M=K„ax) continuing in the direction of decreasing M, a search is sequen- 
tially conducted for elements G(M,N) which are Indicated by "1" (indicating an valid partial region). The value Mr of 
the Initial M of a section In which Indicators having a value of "1 " are continuous for Kq (Kq Is a predetermined number) 
or more indicators is set as the right margin of the fingerprint area for the current N. From the preceding, the partial 
5 region fingerprint boundary Information {(Nj, Ml, Mr), = 0 - K^^^J is calculated. 

Step B6 (Fingerprint boundary Infomiation of each pixel) 

[01 1 5] The fingerprint boundary Infomiation of each pixel Is calculated from the fingerprint boundary Infonmatlon {(Nj, 
10 Ml, Mr), WT = 0 - Kn^} for each partial region. The fingerprint boundary Information of each pixel is shown by {{Y-r, 
Xl, Xr). Yt = 0 - (Yh • 1)). For each value of Yj, Xl i X ^ Xr Is the fingerprint area. 

[01 16] According to the fingerprint boundary infoimation of the partial region, in N = 0 - K^, with regard to Y = Y^- 
ofKxN^Y$KxN + K„3x. the fingerprint boundary infomiation {(Yy, Xl, Xr), Y7 = 0 - (Yh - 1)) of each pixel Is 
calculated wherein: 

IS 

Xl = K»Ml 



20 Xr - K • Mr + K„a^ 

(End of procedure B) 

[01 17] FIG. 1 0 is an example of a table showing the valid partial regions of a fingerprint. From this point on, for the 
sake of simplrcity, the term "fingerprint boundary information" will indicate the fingeqsrint boundary infomiation ((Y-r, 
2s Xl, Xr), Yt = 0 (Yh - 1)} of each pixel. In addition, with regard to background segregation, It is possible to simply 
process the entire image as the fingerprint region in place of steps B4 B6. 

(5) Means for calculating an approximate center point 

30 [01 1 8] With regard to the approximate center point of the fingerprint Image, a means is provided for cateulating the 
center point ([Xh/2], [Yh/2]) of image 10 or an approximate center point (Xq, Yq) from among neighboring points. In 
addition. It Is also possible to optionally use a conventional means for calculating the approximate center point. 

(6) Thinning Means 

35 

[01 19] Thinning is a process for setting the majority of a line width of an image to one pixel. It Is possible to optionally 
use any thinning method (e.g., conventional thinning methods mentioned before) as the thinning means. 

(7) Nan-owing Process 

40 

[0120] The narrowing process maintains the majority of the line widths of an image to a specified line width or less. 
This nan-owing process is basteally achieved by means of standardizing the ratio of black pixels to total pixels (optionally, 
the ratio of white pixels to total pixels or ratio of black pixels to white pixels) in the binary conversion process, hence 
this is considered an aspect of the nanrowing process as well. Furthermore, the following methods can be used to 

45 narrow the line width of a binary image, 

[0121] Aggregations of one or more black pixels are treated as the lines of an image. The method of maintaining the 
,^ designated line width value Is optional, as it Is possible to maintain a designated value as input Infomnatton of the 
narrowing process and/or maintain this value within the narrowing process. It Is also possible to maintain one or more 
designated line width values within a single narrowing process, in the preferred embodiments of the present invention, 

so the procedure of narrowing can be appropriately used in response to the designated line width value. An example of 
a narrowing process which depends on the designated line width value is presented below. 

(a) Narrowing process for setting the majority of line widths to one pixel (Designated line width value is one pixel) 
It is possible to use a conventional method (i.e., a thinning method which can set the majority of the line widths 

ss to the width of one pixel) as a procedure for narrowing the line width of a binary Image (or a procedure for binary 
converting a gray-scale image and nanrowing the line width therein). Furthemiore, other methods also exist for 
directly performing binary conversion and narrowing of a gray-scale image. 

(b) Nannowlng process for nanxiwing the majority of lines to a width below a designated line width (Designated line 
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width value is a random Integer) 

[0122] This process may aiso be realized using a conventional method. For example, a method such as the following 
is available. 

5 

i) In the case when a narrowing process, in which the process of removing the components of a line, one pixel at 
a time, is repeated from the outer side of a line fomiing an image (in the preferred embodiments of the present 
invention, this corresponds to the blacic pixels which represent the fingerprint lines) until the majority of the line 
widths are modified to one pixel, it is possible to set the repetition number In the nanx>wing process as follows: 

10 

Repetition number = {(Maximum line width of original binary image)-(deslgnated line 
width value)}/(Approximate number of pixels to be deleted from 

IS 

each line width using a single image plane treatment process) 

ii) Narrowing method in which blacic pixels are kepi in the center of the line components fomning an image 

20 [01 23] With regard to the black pixels on the line segment of a section where an random straight line and the line of 
an image intersect, nan'owlng can be accomplished by means of keeping black pixels below a designated line width 
value including the center point of said line segment (in the case when the line segment width exceeds the designated 
line width value, the center point of the line segment Is set as the center and the black pixels of the designated line 
width value are kept; all black pixels on the line segment which does not satisfy the designated line width value are kept). 

25 [01 24] In the preferred embodiments of the present Invention, when perf onning the nan'owlng process on a registered 
fingerprint image and a test fingerprint image, the designated line width value may be randomly set. However, it Is 
necessary to define this value on the basis of such factors as the quality and characteristics of the input Image, the 
performance with respect to the designated line width value In the nan'owlng process, the performance required by 
image processing device 1 , and the like. If the difference between the designated tine width values in the narrow 

30 processing of a registered fingerprint and a test fingerprint, respectively. Is large, the errors in aligning both images 
becomes considerable. If this aforementioned difference becomes too large, a decrease in the accuracy of the com- 
parison sometimes occurs. Providing a smaller line width for the modified Image of a registered fingerprint allows for 
a reduction In the amount of memory required for registered information due to a decrease in the number of pixels. 
Taking the aforementioned into consideration, either of the following designations will be effective. 

35 

(a) In the nan'owlng process of a registered fingerprint image, the designated line width value Is set to one pixel; 
in the narrowing process of a test fingerprint, the designated line width value Is appropriately set to a value of at 
least two pixels. 

(b) The designated line width values are appropriately selected according to the conditions wherein the designated 
40 line width value for the nan'owlng process of a registered fingerprint is set to a value smaller than the designated 

line width value of the test fingerprint. 

(c) In the processing of a registered fingerprint image, the designated line width value Is set to one pixel; in the 
narrow processing of a test fingerprint, the designated line width value is appropriately adjusted according to the 
ratio of black pixels at the time of binary conversion (this case Is presented in the following embodiment). 

45 

(8) Process for recording the registered infonmatlon of a registered image 

[0125] The process of recording fingerprint infonnatlon involves extracting sub-template RT(0) and non-sub-template 
RB(0) from the modified Image Rth of the registered fingerprint in Image 10, whteh results from Inputting a registered 

so fingerprint into image 1 0 of image memory 4 and then performing the above narrowing process, and then storing the 
aforementioned sub-template Rr(0) and non-sub-template RB(0) in respective file memory. The procedure for per- 
foiming this recording process of the fingerprint infonnatlon is illustrated by procedure R. The input infonnatlon of 
procedure R is the file name of the sub-template and non-sub-template of the registered fingerprint, the modified Image 
Rth of the registered fingerprint, the fingerprint boundary infonmation of the registered fingerprint and the approximate 

55 center point of the registered fingerprint (Xrc» Yrc) • "The output Information of procedure R Is the file of the sub-template 
RT(0) and the file of the non-sub-tenrplate RB(0). 
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(Procedure R) 

Step R1 (Formation of sub-template Frr(0)): 

s [0126] Black pixel addresses wtthin the fingerprint area and within the range of sub-template RT(0) are extracted 
from modified Image Rth of the registered fingerprint to fomi the file of sub-template RT(0). In the storage file of RT 
(0), the approximate center point of the registered fingerprint (Xnc^Rc) ^'^^ stored. 

Step R2 (Formation of non-sub-tennplate RB(0)): 

10 

[0127] A black pixel address whbh is outside sub-template RT(0) and within fingerprint area FA is extracted from 
modified Image Rth of the registered fingerprint to form the file of non-sub-template RB(0). 
[01 28] Furthermore, storage format of each file of the sub-template and non- sub-template Is optional. For example, 
data may be compressed and stored In a file, and, at the time of utilization, data elongation may be performed. 

15 

StepRa 

Step R3a (Fomnation of a file RSa of a sweat gland hole) 

20 [0129] This step Is executed in the case when optionally selecting to check a sweat gland hole. In a previously 
determined region of a registered fingerprint, a specified number of addresses corresponding to holes (holes formed 
by white pixel aggregations in a binary image wherein ridge lines are represented by black pixels) fornied from sweat 
glands exceeding a predetemiined size are calculated by using means for a hole search, and the central address 
among these addresses is recorded in the file of a sweat gland hole. 

25 

Step R3b (Formation of a file RSb of a sweat gland non-hole) 

[0130] This step is executed in the case when optionally selecting to check a sweat gland non-hole.. In a previously 
determined region of a registered fingerprint, a specified number of addresses, corresponding to areas In whk:h sweat 
so glands exceeding a predetermined size do not exist, are cateulated by means of a non-hole searching means, and the 
central address among these addresses is recorded In the file of a sweat gland non-hole. 

(End of procedure R) 

(9) Hole Search Means (Procedure WH) 

35 

[0131] An example of a hole Is shown in FIG. 11 (a). It is possible to detect the aforementioned hole by means of 
the following procedure WH. (Procedure WH) 

Step WH1 : 

40 

[0132] In searching for a hole in the image, prospective addresses are sequentially examined, and a random white 
pixel address A is selected. With regard to this prospective address, it is possible, for example, to select all of the 
pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

« Step WH2 : 

[0133] The pixels connected around the neighborhood of the white pixels of address A are checked In order to 
determine whether or not a white pixel aggregation AA, In which a specified number of pixels are connected, exists. 
In the case when this white pixel aggregation AA does not exist, the process is re-executed from the beginning of 
50 procedure WH, while In the case when this white pixel aggregation AA exists, the procedure moves to step WHS. 

StepWH3 : 

[0134] in this step, a check is conducted as to whether or not the white pixel aggregation AA Is surrounded by a 
S5 group of connected black pixels. In the case when a series of connected black pixels do not surround white pixel 
aggregation AA, the process is re-executed from the beginning of procedure WH* In the case when white pixel aggre- 
gation AA Is surrounded by a group of connected black pixels, white pixel address A is recognized as the address of 
a hole. 
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StepWH4 : 

[0135] The present procedure WH fs then repeated on all prospective addresses to be searched. 
(End of procedure WH) 

5 

(10) Non-Hole Search Means (Procedure NWH) 

[0136] An example of a non-hole Is shown In FIG. 1 1 B. It is possible to detect the aforementioned non-hole by means 
of the following procedure NWH. 

10 

(Procedure NWH) 
Step NWH1 : 

'5 [0137] In searching for a non-hole In the image, prospective addresses are sequentially examined, and a random 
black pixel address B Is selected. With regard to this prospective address, it Is possible, for example, to select all of 
the pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

Step NWH2 : 

20 

[0138] The pixels connected around the periphery of the black pixels of address B are checked in order to determine 
whether or not a black pixel aggregation BB, in whteh a specified number of pixels are connected, exists. In the case 
when this black pixel aggregation BB does not exist, the process Is re-executed from the beginning of procedure NWH. 
In the case when this black pixel aggregation BB exists, black pixel address B is recognized as the address of a non- 
25 hole. 

Step NWH3 : 

[0139] The present procedure NWH Is then repeated on all prospective addresses to be searched. 
30 (End of procedure NWH) 

(11) Image Data Recording Means 

[0140] When storing the address of each black pixel (X.Y) as originally presented In a file, the memoiy capacity 
35 required is as follows: 

Memory Capacity - (Number of black pixels) • [(Unit memory capacity of X- 
^ coordinate) + (Unit memory capacity of Y-coordinate)] 

[01 41 ] It Is necessary to store infomiation regarding the sub-template and the non-sub-template, respectively. In the 

files of a registered fingerprint image, in order to reduce the amount of storage data to less than when black pixel 
addresses of a binary image are recorded in their original states, the data is compressed and recorded in a file without 
45 an increase in the processing amount. The following process Is an example of the aforementioned. 

[0142] The following case is for a 4 x 4 pixel aggregation. A 4 x 4 pixel aggregation Is shown in FIG. 3 for optional 
representative pixel Pq. The black and white classification of each pixel is shown by bits. With regard to Pq P^5, the 
black pixel and white pixel states of each neighboring pixel can be shown by means of the 2 byte pixel aggregation 
code Q (OOOO'-FFFF by hexadecimal digits), in accordance witii the following: 

so 

Q=Pi5llPl4llPl3lL..IIP7llPellP5llP4llP3llP2llPillPo 

The pixel address (X,Y) shown In FIG. 3 (b) which Is detemiined by means of the representative pixel Pq^PCc'^o) 
55 the relative position therein, is expressed as follows: 

Pv X=Xo-1 Y=Yo 
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25 



30 



35 



40 



Pg: X=Xo-2 Y=Yo 

P3: X=Xo-3. Y=Yp 

P4: X=Xo, Y=Yo-1 

P.: X=Xo-1. Y=Yo-1 



Pg: X=Xo.2. Y=Yo-1 



Pyi X=Xo-3, Y=Yo-l 

Pg: X=Xo, Y=Yo-2 

Pg: X=Xo-1. Y=Yo-2 

P,o: X=Xo-2. Y=Yo-2 

P^y X=Xo-3, Y=Yo-2 

P12: X=Xo. Y=Yo-3 

P13: X=Xo-1, Y=Yo-3 

P„: X=Xo-2. Y=Yo-3 

P^g: X=Xo-3. Y=Yo-3 



The compression processing of the registered fingerprint Image data involves converting the (X, Y) coordinate of the 
registered fingerprint Image data (X= 0~Xh, Y= O-Yh) to the following form. With regard to the area within the valid 
45 region of a fingerprint, each fourth X-coordinate Is set to each fourth Y-coordinate as the representative pixel, after 
which the range of the 4 x 4 pixel aggregation is checked to determine whether or not any black pixels exist. The X- 
coordinate of the representative pixel and the pixel aggregation code are only stored in the case when black pixels are 
present. 

[0143] In order to designate the portion of the X-address at four pixel intervals, the lower two bits may be used as 
50 format identiffcation data of the pixel aggregation. In this manner, when half (lower half, upper half or left half) of the 
pixel aggregation code Is represented by white pixels, a partial pixel aggregation is expressed by one byte of the 
remaining half of the pixel aggregation code (in accordance with the abovenfnentioned order, upper half, lower half, or 
right halQ. 



55 (a) When the format Identification data of the pixel aggregation is expressed by a bit indicator of "11", the pixel 

aggregation code is expressed by two bytes (I.e., P^^ 11 P^4 11... IIP^ II Pq). 

(b) When the fomiat Identlfk^tion data of the pixel aggregation is expressed by a bit indicator of "10", the pixel 
aggregation code is expressed by one byte of the upper half (i.e.. P^g 11 P^4 11 P^^ 11 P^^ ^ii I' ^lo ^9 ^s)- 
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(c) When the format Identification data of the pixel aggregation Is expressed by a bit Indicator of "01 the pixel 
aggregation code is expressed by one byte of the lower half (i.e., P7 11 II P5 11 P4 II P3 II P2 II Pi II Pq). 

(d) When the fomiat Identification data of the pixel aggregation is expressed by a bit Indicator of "00", the pixel 
aggregation code is expressed by one byte of the right half (e.g.. P^^ 11 P^g 11 P9 II Ps II P5 i I P4 11 Pi II Pq). 

[0144] When the pixel aggregation code is expressed by 1 byte, the omitted pixels are all white pixels. In the case 
when the pixel aggregation code Is expressed by 1 byte, conversion of the X-address portion, incorporating two bits 
for use in the fonrtat identification data of the pixel aggregation, into a pure X-address is possible by means of setting 
the bit portion for use in the fomiat identification data flag of the pixel aggregation to "0". 

[0145] In other words, at the time of compression, the (X,Y) coordinates of the image data (I.e., X= O-Xh, Y= O-Yh) 
Is converted to the following fonm. Each fourth X-coordlnate is set to each fourth Y-coordinate as the representative 
pixel, after which the range of the 4 x 4 pixel aggregation is checked to detennine whether or not any black pixels exist. 
The X-coordinate of the representative pixel and the pixel aggregation code are only stored in the case when black 
pixels are present. An example of the process for recording tiie binary image at this time is illustrated by procedure G 
below. 

(Procedure G) 

StepGI : 
20 

[0146] Based on the X-address portion, 4x4 pixel aggregations are sequentially selected. All of the pixels (Pis^Pq) 
are then checked to determine whether or not these pixels are all white pixels. When ail of the pixels are white pixels, 
the current 4x4 pixel aggregation Is skipped, and step G1 Is conducted on the subsequent 4x4 pixel aggregation 
from the beginning. When all of the pixels are not white pixels, the procedure moves to step G2. 

25 

Step G2 : 

[0147] The upper half of the pixel aggregation (Pts'-Pa) Is then checked to detennine whether or not these pixels 
are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G3. When the upper half 
30 contains all white pixels, the lower half of tiie pixel aggregation (Py-^Po) is expressed by a pixel aggregation code of 
1 byte. The lower two bits of tiie X-address portion are then set to a bit pattern of "01 ". 

StepG3 : 

35 [01 48] The lower half of tiie pixel aggregation (P7--P0) is then checked to determine whettier or not tiiese pixels are 
all white pixels. When all of the pixels are not white pixels, the procedure moves to step G4. When the lower half 
contains all-white pixels, the upper half of tiie pixel aggregation (Pis-Ps) is expressed by a pixel aggregation code of 
1 byte. The bwer two bits of the X-address portion are tiien set to a bit pattern of "10". 

40 Step G4 : 

[0149] The left half of the pixel aggregation (P15, P14, P^^ , P^q. P7. Pe. P3> ^2) ^ checked to delemilne whetfier 
or not ttiese pixels are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G5. 
When the left half contains all white pixels, the right half of the pixel aggregation (Pig 11 P12 II P9 II Pg II P5 11 P4 II Pi II 
45 Pq) Is expressed by a pixel aggregation code of 1 byte. The tower two bits of the X-address portion are then set to a 
bit pattern of "00". 

Step G5 : 

so [01 50] In this step, tiie 4 x 4 pixel aggregation Is expressed by a pixel aggregation code of 2 bytes. The lower two 
bits of the X-address portion are then left in ttieir original fomi (i.e., bit pattern of "11"). 

Step G6 : 

ss [0151] The processing of this pixel aggregatton code and X-address is then completed. 
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Step G7 : 

[0152] Steps G1 ~ G6 are then repeated with respect to all 4 x 4 pixel aggregations for each X-address. 
Step G8 : 

[0153] In this step, the binary Image Is recorded by setting the file storage format as follows: 
Y-coordinate = Ys, number of groups in stored X-address portion, 

{{X-address portion of representative pixel As (Including 2 bits of the fomriat Identification data of the pixel aggre- 
gation), Pixel aggregation code), (X-address portion of representative pixel Bs (Including 2 bits of the fonnat Identifi- 
cation data of the pixel aggregation), Pixel aggregation code), . . .} 



Y= 3 + 4J, number of groups In stored X-address portion, 

{(X-address portion of representative pixel Aj (including 2 bits of the format identification data of the pixel aggre- 
gation), Pixel aggregation code), (X-address portion of representative pixel Bj (including 2 bits of the format identification 
data of the pixel aggregation), Pixel aggregation code), . . .} 



Y= Ye: number of groups in stored X-address portion, 

{(X-address portion of representative pixel Ah (including 2 bits of the fonnat Identification data of the pixel ag- 
gregation). Pixel aggregation code), (X-address portion of representative pixel Bh (including 2 bits of the fonnat iden- 
tification data of the pixel aggregation), Pixel aggregation code),...}, {termination indictor) 
(End of Procedure G) 

[0154] The number of groups of the stored X-address portion Indicates the number of pixel aggregation codes cor- 
responding to the Y^oordinate at the time to be stored. The number of groups of the stored X-address portion are 
detemiined without designating a Y-coordinate of "0". In addition, 4x4 pixel aggregations which contain only white 
pixels are not recorded. The pixel aggregation codes may be expressed by either 1 byte or 2 bytes, and are classified 
by the lower two bits of the X-address portion. Furthemnore, It Is also possible to add groups of termination signals (e. 
g., of the X-address portion of the representative pixel and pixel aggregation code) at each Y-coordinate value In place 
of the groups of the stored X-address portion. 

[0155] FIG. 12A show an example of the case when the Image memory Is divided Into small regions of 4 x 4 pixel 
aggregations. FIG. 12B shows an example of the upper half of a 4 x 4 pixel aggregation. FIG. 12C shows an example 
of the lower half of a 4 x 4 pixel aggregation. FIG. 1 2D shows an example of the right haif of a 4 x 4 pixel aggregation. 
Furthennore, in the aforementioned, the case in which the Image memory Is divided Into small regions of 4 x 4 pixel 
aggregations is presented, however, it is possible to optionally designate both the size of the small regions and the 
method of division within the small regions. 

[0156] In addition, in order to return the format of the binary image data compressed in procedure G bacic to its 
original (X,Y) form. It Is sufficient to simply reverse the sequence of procedure G. 

(12) Means for Comparing a Registered Image and Test Image 

[01 57] Comparison process Is a process for checking the concordance of each black pixel of a blacic pixel aggregation 
In a modified image of a test fingerprint, with each black pixel In a black pixel aggregation which has been stored In 
memory 6 as registered Information relating to the modified image of a registered fingerprint. 
[01 58] Coordinate conversion by means of rotational and parallel disptacement in order to align a registered finger- 
print and a test fingerprint, can be carried out for either Image. However, In the prefen^ed embodiments herein, the 
modified image of the registered fingerprint Is displaced to align It with the modified Image of the test fingerprint, since 
the modified image of the registered fingerprint has a smaller value than the designated line width value of the nanx>wlng 
process. An outline of the comparison process Is described below. 

(a) Comparison of the Sub template 

The comparison of the sub-template Is the process of cateulating the position at which the black pixels of the 
Image of the registered fingerprint and. the black pixels of the Image of the test fingerprint have the greatest degree 
of concordance. In other words, first, a sub-template RT(0,iH,V). in which the approximate center point of the 
registered fingeiprint has been aligned with the approximate center point of the test fingerprint, Is calculated for 
s ub-template FTr(O) of modified image of a registered fingerprint by means of parallel displacement of the coordinate 
axis of this registered fingerprint. Subsequently, following the rotational and up^down, teft/right parallel displace- 
ments of the coordinate axis of sub-template RT(0,H,V) In the neighboring area about the center, the transformation 
angle S and the parallel displacement quantity (horizontal displacement quantity IH, vertical displacement quantity 
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V) of sub-template RT(S,H,V) of the modified Image of the registered fingerprint, at the point where the degree of 
concordance between the black pixels of the registered fingerprint and the black pixels of the Image of the test 
fingerprint is greatest, are catoulated (S,H|V are Integers). 

(b) Comparison of the non-sub-template, and comparison of the template 

The comparison of the non-sub-template Is the process of outputting Infomiation relating to the concordance 
of the registered fingerprint and the test fingerprint by means of performing coordinate conversion of the black 
pixel address of RB(0) of the modified image of the registered fingerprint according to S, IH, V of Rr(S.H,V) of the 
registered fingerprint obtained in the comparison of the sub-templates to calculate the black pixel address, and 
then checking the concordance of this black pixel address with the black pixel address of the modified image of 
the test fingerprint. In other words, initially, coordinate transfomiation of the black pixels of non-sub-template RB 
(0) of the registered fingerprint is perfomied using the angular rotational quantity S, horizontal displacement quan- 
tity H, and vertk^al displacement quantity V, of the coordinate axes of the sub-temptate of the modified image of 
the registered fingerprint obtained above to obtain RB(S,H,V). Next, the concordance of the black pixels of RB(S, 
H,V) of the modified image of the registered fingerprint to the blackplxels of the modified image of the test fingerprint 
is checked. 

(c) A check is conducted to detemilne the number of black pixels of a discordant section. 

(d) This check is conducted when optionally selecting to check the sweat glands. 

(e) in accordance with the above results, a final judgment is made with regard to the concordance of the registered 
fingerprint and the test fingerprint. Based on the outline of the above process, an example of a comparison pro- 
cedure Is shown by procedure C. The sub-template and the non-sub-template of the registered fingerprint, the 
modified image of the test fingerprint and the approximate center point of the test fingerprint serve as the input 
infomiation of procedure C. The output infomnation of procedure C is the comparison result. 

(Procedure C) 

Step CO : 

[0159] The maximum total range of displacement of the registered Image infomiation at the time of comparison is 
expressed as follows: interval [S^^, ^mati represents the rotational angular direction; interval [H„,„, l-l^] represents 
the horizontal direction; and interval [V^, represents the verttoal direction. At least one of the intervals indicating 
the displacement directton is divkled Into one or more partial Intervals as follows: 

S„,in={S,inOs);ls=1,2 Js} 



Sn,ax = {SmaxOs);ls=1.2 Js} 



Hmi„ = {H„Jlh);lh=1.2,.,.,Jh) 



Hmax = {H„3,0h);lh = 1,2 Jh} 



Vmln = {V„b,(lv); lv=1.2 Jv} 



V„,ax = {V„3,(lv);lv=1,2 Jv} 

(01601 Interval [S^^, S^^] is the aggregate sum of interval [S^{X). S^^xOM. interval [S„h(2), S„„(2)l,..., and 
interval [S„in(Js). S„ax(Js)l- 

[0161] Interval [H„,„, H^^] is the aggregate sum of Interval (H„fc,(1). H^(1)], interval [Hrt„(2), H„J?)] and 

Jnten^al[H^h(Jh).H„^(Jh)]. 

[0162] interval [V„^. V„,^] is the aggregate sum of Interval (V„J1), V„„(1)], Interval [V„h(2). V^(2)l and 

interval [V„h(Jv).V„„(Jv)]. 

[0163] Hereafter, from step CI , the selected partial alignment Intervals are sequentially executed with regard to all 
{interval [S^(1), S„„(1)], Interval IS^{2), S^2)] and Interval [S^^m S^Js)]l 
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{interval [H^JI), H^(1)]. Interval [H^„{21 H„^(2)l and Interval \H„^(Jh), H^(Jh)D, and 

{Interval tV„in(1), V^(1)]. Inten^al [V„u,{2). V„„(2)] and Inten^al [V^„(Jv), V„ax(Jv)l}. 

[0164] In a random alignment Inten^al, the entire corr^arfson pntx^ure ends when a Judgment of concordance Is 
rendered, or when a judgment of discordance is rendered after abandoning the following comparison. 

5 

Step C1 (Comparison of the sub-template): 
[0165] Steps CI a - CI d are executed, 
w Step C1a : 

[0166] Sub template Frr(O) Is stored In memory 6 from the file. Subsequently, the following image concordance aux- 
iliary procedure (procedure W) is executed using: sub-template RT(0). S = Sn,|n(ls)-S„ax(ls) (Incremental value Ks of 
S), H = H„h(lh)--H„ax(lh) (incremental value Kh of H) and V= V„h(lv)'-V^(lv) (Incremental value Kv of V) wherein 
IS the registered Infonnatlon black pixel search Incremental value Kr - Kra, (Kra^l ). 

[0167] From this result, with regard to S^,„(ls)^S^3,,{ls), H„,„(lh)--H„a^(lh). and V„b,(lv)-'V„3,(lv). the values of S. 
H and V are modified by Incremental values Ks, Kh and Kv, respectively, and Sa, Ha, and Va (I.e. the quasi-optimal 
values of S, H. and V) are then calculated. 

20 step CI b : 

[0168] With regand to the respective displacement ranges of S, H and V, 
2g S: (Sa - Dsb) (Sa 4- Dsb), incremental value Ksb 



H: (Ha - Dhb) ~ (Ha -i- Dhb), Incremental value Khb 

30 

V: (Va - Dvb) - (Va + Dvb), incremental value Kvb, 

procedure W Is executed wherein the registered Information black pixel search Incremental value Kr = Krb (Krb>1), 
and (Sb, Hb, Vb} (i.e., the quasi-optimal values of {S, H, V}) are calculated. Dsb, Dhb, and Dvb are constants for 
35 defining the displacement range (See C(1 )). 

Step C1 c : 

[0169] With regard to the respective displacement ranges of S, H and V, 

40 

S: (Sb - Dsc) -* (Sb -i- Dsc), Incremental value Ksb 



H: (Hb - Dhc) - (Hb + Dhc), Incremental value Khb 



V: (Vb - Dvc) - (Vb + Dvc), Incremental value Kvb, 

50 procedure W Is executed wherein the registered Information black pixel search Incremental value Kr = Krc (Krc^l), 
and {Sc, He, Vc} (i.e.. the quasi-optimal values of {S, H, V}) are calculated. Dsc, Dhc, and Dvc are constants for defining 
the displacement range. 

Step Cid : 

55 

[0170] Proceldure W Is executed according to S, H, V, 
S=Sc, Dsd=0, Incremental value Ksd=0 
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H=:Hc, Dhd=0, incremental value Khd^O 
V=Vc, Dvd=0, incrennental value KvcM), 

wherein the registered Infonnatlon black pixel search incremental value Kr = Krd (Krd=1), and the optimal values {S, 
5 H, V) are calculated. Dsd, Ohd, and Dvd are constants for defining the displacement range. From this result, each 
optimal value {S, H, V] wherein the degree of concordance T1 of the sub4emplate is maximized and the sub-template 
degree of concordance = N^j^^e 
are obtained. Next, for a predetenmined number T^^ , if 

10 

the registered fingeiprfnt and test fingerprint are judged to be concordant by means of the comparison of the sub- 
templates, and the procedure moves to step C2. On the other hand, if 

15 

T1 <T,, 

the registered fingerprint and test fingerprint are judged to be discordant In the partial alignment Interval undergoing 
20 processing, and the procedure moves to the processing of the subsequent partial alignment interval beginning with 
step 01 . When a partial alignment interval for processing no longer exists, the registered fingerprint and test fingerprint 
are judged to be discordant, and procedure O temiinates. 

[01 71 ] In addition, setting equal to the maximum value of T1 In the partial alignment intervals from 1 to m, when 

25 

due to the low probability of concordance, subsequent processing of the present partial alignment interval, as well as 
comparison processing of the remaining partial alignment Intervals are not executed, the registered fingerprint and test 
30 fingerprint are judged to be discordant, and procedure 0 tennlnates. In order to execute the aforementioned Judgment, 
'^mkio) (ir'^ ^) represents a previously detennined constant. 

Step 02 (Oomparison of the non-sub-template and compariison of the template): 

35 [0172] Using the optimal value {S, H, V} obtained from non-sub^emplate RB(0) and step 01 as Input Information, 
an auxiliary Image concordance checic procedure (procedure W) Is canled out. As a result, and are calculated, 
and the following is then obtained using the result of step 01 : 

[01731 Template degree of concordance 12 = (Ni„ + Na J / (N^g + Next, for a predetemilned constant T^, if 

40 

the registered fingerprint and the test fingerprint are judged to be concordant, and the procedure moves to step 03. 
On the other hand, if 

45 

T2<Tk2 

the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment interval undergoing 
50 processing, and the procedure moves to the processing of the subsequent partial alignment Interval beginning with 
step 01 . When a partial alignment interval for processing no longer exists, the registered fingerprint and test fingerprint 
are judged to be discordant thereby resulting In the termination of procedure 0. 

Step 03 (Comparison of discordant sections): 

55 

[0174] in this step, the discordance of the black pixels of the registered fingerprint and the black pixels of the test 
fingerprint is checked. It is necessary to remove cases In which the numt)er of black pbcels in the discordant section 
of the image of the test fingerprint are too large. For this purpose, the foltowlng steps C3a ~ C3b are carried out to 
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approximately obtain and Judge the ratio of the biack pixels of the discordant section at the point where the line width 
of the binaiy image of the test fingerprint has been aligned with the modified image of the registered fingerprint. 

Step C3a : 

[0175] The approximate range of the area of comparison of the modified Image of the registered fingerprint of {S,H, 
V} is cateulated from the ranges of RT(0) and RB(0), The coordinates (X'.V) in the region following modification of 
coordinates (X.Y) are calculated in the same manner as in procedure W, found by the following fonnnulae: 

(X - Xrc) • cos(S) + (Y . Yrc) . 6in(S) + X^^ - H 



Y'= -(X . Xrc) • sin(S) + (Y - Yr^) • cos(S) + Y^ - V 

15 

Note: cos(») and sln(*} represent trigonometric functions. 
Step C3b : 

20 [01 76] The number of biacic pixels T^^, of the region of comparison following coordinate conversion of the modified 

Image of the test fingerprint (I.e., sum aggregation of m"(S,H,V) and RB{S,H.V.)) is counted. In other words, 
* ^nw = number of blacl< pixels in the region of comparison 

following coordinate conversion of the test fingerprint image 
At this time, when the line width of the modified image of the test fingerprint is represented by w, the total number of 
2S black pixels T„; when this line width Is set to the line width of the modified Image of the registered fingerprint (line width 
X) is given approximately by: 

30 

[0177] When the line width of the modified image of the registered fingerprint reaches one pixel by means of thinning, 
It Is possible to calculate the number of black pixels Tn,,, of the region of comparison of the modified image of the test 
fingerprint by thinning this modified image of the test fingerprint. In this case, w = X = 1 . In addition, the following has 
already been calculated: 

35 

Nim+'^2m- Number of concordant black pixels within the region of comparison following coordinate conversion 

of the modified image of the test fingerprint and the modified image of the registered Tingerprint 

Nic + = Total number of black pixels within the region of comparison following coordinate conversion of 
the modified image of the registered fingerprint 

40 

[0178] The degree of discordance Tz of the black pixels may. for example, be expressed as follows: 

Tz = n"nc-N,„.N2„)/(N,, + N2,); 

45 

In the above case, when 

ITzl^Tte, 

50 

with regard to the degree of discordance, the registered fingerprint and the test fingerprint are judged to be concordant; 
in the case where these conditions are not met, the registered fingerprint and the test fingerprint are judged to be 
discordant. 

[0179] Tkc (0 ^ Tjjc ^ ) *s a constant indteating the allowable rate of discordant black pixels of the binary image of 
S5 the test fingerprint; as this number decreases, the conditions become stricter (note: nomially, Tz ^ 0, thus It is also 
possible to make the conditions stricter when Tz < 0, then when Tz ^ 0, by using different values for T|J. When the 
registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment interval undergoing 
processing, the procedure moves to the processing of the subsequent partial alignment Interval beginning with step 
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CI . When a partial alignment Interval for processing no longer exists, the registered fingerprint and test fingerprint are 
Judged to be discordant thereby resulting in the termination of procedure C. ^ 

StepC4 (Comparison of the sweat gland portions): 

5 

[0180] In the present step, in order to increase the accuracy of the comparison, it is possible to selectively add at 
least one of the following steps C4a and C4b. 

StepC4a (Checking of holes from sweat glands): 

10 

[0181] The hole address modified using optimum value {S, H, V) is checked to determine the existence of a sweat 
gland in the addresses of the modified image of the test fingerprint (note: holes are formed by one or more white pixels 
In an image in whteh the ridge portions of a fingerprint are represented by black pixels following binary conversion). 
The size of the white pixel aggregation to be checked is represented by parameter constants. Subsequently, when, as 
IS a result of perfonnlng the following catoulatlon, ^ T^^, the checking of the hole of a sweat gland is Judged to be 
successful. 



20 



25 



= (Number of concordant hole addresses) / (Total number of registered hole addresses) 
StepC4b (Checking of non-holes): 

[0182] The non-hole address modified using optimum value (S, H, V} Is checked to detemnlne the non-existence of 
a sweat gland in the addresses of the modified image of the test fingerprint. The size of the white pixel aggregation to 
be checked is represented by parameter constants. Subsequently, when, as a result of periomning the following cal- 
culation, T45 €t T|(4|,, the checking of a non-hole is Judged to be successful. 



T44, = (Number of concordant non-hole addresses) / (Total number of registered non-hole addresses) 

30 

Note: is a threshold value constant. 
Step C5 (Rnal Judgment): 

^ [0183] With regard to the processed partial alignment Interval, when the sub-template concordance rate, template 
concordance rate, discordant section rate, and sweat gland check have been successfully completed, the registered 
fingerprint and the test fingerprint are judged to be concordant, thereby resulting in the tennination of procedure C, 
However, when the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment 
inten^al undergoing processing, the procedure moves to the processing of the subsequent partial alignment interval 

^ beginning with step CI. When a partial alignment interval for processing no longer exists, the registered fingerprint 
and test fingerprint are Judged to be discordant thereby resulting in the tennination of procedure C. 
(End of Procedure C) 

[0184] FIGS 1 3A and 1 SB deptet a flow diagram showing an outline example of the above comparison process based 
on procedure C. Furthemrwre, FIGS 1 3A and 1 SB illustrate an example In which only an Interval of an angular rotational 

^ direction S Is divided to fomi partial alignment intervals. 

[0185] FIG. 14 is a diagram for explaining the checking of discordant sections in the aforementioned comparison 
process. Tliis figure shows the relationship between concordant and discordant sections when the line width of the 
modified Image of a test fingerprint is aligned with the line width of the modified image of a registered fingerprint. 
Remarks C(1 ): Each value of the incremental values (Ks, Kh, Kv), which represent the Incremental widths of the primary 

^ displacement in step C1a, is checked as a rough value over a comparatively wide range. Each value of the incremental 
values (Ksb. Khb. Kvb). Incorporating the quasi-optimal values of the (S,H,V) obtained in step CI a, whteh represent 
the incrernental wkiths of the second displacement in step Clb, is checked as a precise value over a comparativeiy 
narrow range. In this manner, when the range of displacement during alignment Is large, a greater reduction in the 
processing quantity can be achieved when compared to the case in which fine Incremental values are used, 

^ [0186] In step CI (a multi-stage process comprising 3 steps) of procedure C, the incremental value of each value of 
displacement can be increased to greater than 1 in the first and second steps; In the second and third steps, these 
values can be compared over the range defined by means of the line width in the prior step as the cardinal point of the 
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quasi-optimal values of S, H, and V which were determined in the prior step; and it is possible to reduce the processing 
quantity of the comparison (approximately proportionate to the position matching search repetition) due to the fact that 
the number of black pixels of the registered Image can be limited through a skipping procedure which skips a fixed 
number of the black pixels of the registered infomfiation in accordance with setting the registered infonnation black 
5 pixel search width Increment Kr to a value of 2 or greater. The maximum and minimum values of each displacement 
range (S^„, S^, Hmin» *^max» ^m\w Vmax) defined according to the maximum pennlsslble displacement ranges at 
the time of fingerprint input. Step Cid is for the purpose of determining T1 in step CI . 

[0187] The following characteristics are present. (1) The number of search repetitions increases with Increasing 
displacement range; (2) The number of search repetitions Increases with decreasing incremental value; (3) The Incre- 
10 mental value at a midway step is defined by taking Into consideration the incremental width of the immediately preceding 
or immediately succeeding step; (4) For steps other than the final step, a skip search is possible; (5) When the desig- 
nation of the translation limits, the incremental value and the jump search Is not appropriate, enx>rs In recognition occurs 
easily. 

[0188] In step C3b, the degree of discordance sections is calculated by approximately setting the line width of the 
15 modified Image of the test fingerprint to the line width of the modified Image of the registered fingerprint. However, it 
is also possible to calculate the rate of discordant sections by approximately setting the line width of the modified Image 
of the registered fingerprint to the line width of the modified image of the test fingerprint. 

(13) Auxiliary Procedure for Checking Image Concordance 

20 

[0189] A summary of an auxiliary procedure (Procedure W) for conducting a check on the concordance of two Images 
is explained in the following. The approximate center point (XptQ, Yf:)^) for each pixel address (Xp,Yp) of the sub-template 
RT(0) or non-sub-template RB(0) of the registered fingerprint undergoes parallel displacement so as to become con- 
cordant to the approximate center point (Xjq.Yjq) of the test fingerprint Next, the coordinate axis of the registered 
25 fingerprint is rotated, the black pixel (X|:)Q,Yf)o) address following conversion is checked as to whether or not any 
black pixels exist withjn the fingerprint area of the modified image of the test fingerprint, and parallel displacement is 
again carried out. 

[0190] In the case of RT(S,H,V), S, H and V, and T1 , N^^ and N^^. are calculated for the time when the degree of 
concordance T1 reaches a maximum for each value of S, H and V. With regard to RB(S,l-l,V)i S, H, and V each re- 
so spectlvely represent only one case. Additionally, in procedure W, T1 and T2, and Ngm, and N^^ and Ngc are refen-ed 
to as T", "Nn,", and "Ng", respectively. 

[0191] The aggregation of black pixel addresses of a specified portion of the modified image of the registered fin- 
gerprint (either RT(0) or RB(0)), angular conversion quantity S of the coordinate axis (minimum value, maximum value, 
incremental value), horizontal displacement H of the coordinate axis of the registered fingerprint (minimum value, 
35 maximum value, Incremental value), vertical displacement V of the coordinate axis of the registered fingerprint (mini- 
mum value, maximum value, incremental value), the modified image of the test fingerprint and the skip count J based 
on the skip search of the black pixels of the registered fingerprint serve as the input information of procedure W. The 
displacement range is the entire interval or partial interval. 

[01 92] When comparing the black pixels of the registered fingerprint with those of the test fingerprint, the registered 
^ information black pixel search Incremental value Kr designates the Increment by which the black pixels of the modified 
image of the registered fingerprint are searched. For example, when i<r=:1 all of the black pixels of the modified image 
of the registered fingerprint are searched, and when Kr=2, every other black pbcel of the registered fingerprint is 
searched. 

[0193] The optimal angular degree of rotation S about the coordinate axis for the registered fingerprint, the optimal 
^ coordinate axial horizontal displacement quantity H, the optimal coordinate axial vertk^al displacement quantity V, the 
number of concordant black pixels N^^ of the modified image of the test fingerprint and the modified image of the 
registered fingerprint In the specified region (either RT (0) or RB(0)) , the total number of black pixels of the modified 
Image of the registered fingerprint of the specified region and the degree of concordance T. 
[0194] FIG. 15 is a flow diagram showing an outiine of the auxiliary procedure for checking Image concordance 
50 (Procedure W) In the comparison process. An example of the processing of procedure W is explained in the following. 

(Procedure W) 

Step W1 (Selection of angle S): 

55 

[0195] Depending on the Input Infonnation of angle S, with regard to the designated interval, S is sequentially selected 
by means of the Incremental value of S from the minimum value of^S to the maximum value of S (i.e., the minimum 
value of 8 is S„|„, the maximum value of S is S^, and when the incremental value Is Ks, S varies from S,^ to S^ 
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according to S = S^^{\s), S„(„(l8HKs S^, following which the procedure moves to step W2. 

Step W2 (Coordinate conversion according to angle S): 

5 [01 96] With regard to the black pixels of the modified image of the inputted registered fingerprint (either RT(0) or RB 
(0)), and with respect to the black pixel address (Xp, Y^^ which Is to be searched using the registered infomiation black 
pixel search incremental value Kr, 

(a) when S = 0, 

10 

^RO = ^R " ^RC + ^TC 



15 ^Bc - Yr "Yrc + y-rc 

are set. 

(b) whenS^tO, 

20 [0197] Following parallel displacement to align the approximate center point (Xf^c^Rc) of the registered fingerprint 
to the approximate center point of the test fingerprint {X^q^jq), coordinate axis rotation over an angle Is perfonned 
with respect to all of the black pixel addresses (X^,, Y^ of a black pixel aggregation of the modified image of an inputted 
registered fingerprint (either RT(0) or RB(0)). This is canled out according to, 

= (Xr-Xrc) • cos(S) + (Yr-Yrc) • sin(S) + X^ 



Yr« = -(Xr-Xrc) • sin(S) + (Yr^Yrc) • cos(S) + Y^ 

30 

Accordingly, an aggregation of all black pixel addresses (Xro ,Yro) of the new registered fingerprint at the time when 
H=V=0 is calculated. 

[0198] According to the above, the approximate center (Xrc.Yrc) of the registered fingerprint is rotated S degrees 
about the coordinate axis of the registered fingerprint and an aggregation of all black pixel addresses (Xr^.Yr^) of 
35 the new registered fingerprint Is obtained when: 

[0199] Horizontal displacement H = Vertical displacement V = 0 

Step W3 (Calculation of the degree of concordance T): 

40 Step W3a : 

[0200] initially, the counter for the number of concordant black pixels Nm and the counter for the total number of 
black pixels of the modified Image of the registered fingerprint are respectively reset to "0". 

45 Step W3b : 

[0201] For each address of the aggregation of (XpotYRo), the modified image of the test fingerprint is checked while 
applying the following: 

50 (a) If the aggregation consists of black pixels within the fingerprint area, "1 " is added to the counter for the number 

of concordant black pixels N„, and 'ris also added to the counter for the total number of black pixels of the 
registered fingerprint. 

(b) If the aggregation consists of white pixels within the fingerprint area, or if the aggregation lies outside the 
fingerprint area (trpated as neither white nor black), T is added to the counter for the total number of black pixels 
55 of the registered fingerprint. 

At this point, a check is perf omied to determine whether or not the abandonment of the comparison is possible for {S, 
H,V} in the comparison processing of the sub-template. 
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[0202] In other words, since the registered fingerprint Information to be checked Is an aggregation of black addresses, 
this information Is classified into k continuous Intervals according to the search sequence; at the end of each interval 
i(U1,2. ...,k), when 

5 

counter = N^, , 

the Nm at this time is set to N„, (i=1.2,...k), and the degree of concordance up to that point of the pattem defined 
according to the values of S, H and V. is represented by N„, / N^, and thus, with regard to a constant Tel (1=1 ,2,...,k), 
10 in the case when 

Nml'N^<Tc|,(M,2....k). 

IS (T^ji and k are constants. See Remarks W(1 ).) even if a subsequent check is conducted, there will not be a significant 
degree of concordance obtained at the current values of S, H, and V, hence the current S, H, and V values at this point 
are discarded, and the procedure moves to step W4 in order to advance to the subsequent S, H, and V values. 
[0203] The following process (neighboring pixel search at the time of comparison) can be selectively performed (This 
neighboring pixel search process can be selectively applied at each processing stage of the sub-template RT, and/or 

20 at the stage of the non-sub-template RB.). 

[0204] The case when the black pixel of the modified image of the registered fingerprint of an optional address (e. 
g. , address A) within the image corresponds to the black pixel of address A of the modified image of the test fingerprint, 
is refen^ed to as "concordance" or "true concordance" with regard to the pixel. 

[0205] When the black pixel of the modified image of the registered fingerprint of an optional address (e.g., address 
25 A) within the image con^esponds to a white pixel of the same address A of the modified Image of the test fingerprint, 
the neighboring addresses of address A of the modified Image of the test fingerprint are checked for the presence of 
black pixel. When at least one black pixel is present, the black pixel of the modified image of the registered fingerprint 
of address A is judged to be concordant with the black pixel of the modified image of the test fingerprint (when it is 
necessary to distinguish such concordance from true concordance, such concordance Is referred to as "approximate 
30 concordance**). At this time, during comparison of the black pixel of the modified Image of the registered fingerprint, It 
is designed such that the approximately concordant black pixels, as well as the concordant black pixels of the modified 
Image of the test fingerprint are not used for comparison more than once. In order to achieve this result, the following 
operations are conducted. 

[0206] The modified image of the test fingerprint is placed into the working area of memory. With regard to the black 
35 pixels of the modified Image of the test fingerprint which have been judged to be concordant with the black pixels of 
the modified image of the registered fingeq^rint by means of either true or approximate concordance, the pixel value 
of Image memory Is converted into an Intemriedlate value other than the brightness value of a black or white pixel (e. 
g, , when the brightness of a black pixel and white pixel are "0" and "255", respectively, the brightness of true concord- 
ance is Ba (e.g., a value other than that of a black pixel or white pixel, such as "50"), and the brightness of approximate 
40 concordance is Bb (e.g., "1 00")), in the comparison of the black pixel of the modified Image of the test fingerprint and 
the black pixel of the modified image of the registered fingerprint, repeated comparison of concordant and approximately 
concordant black pixels of the tesf fingerprint of addresses within the same fanage Is prevented since previously com- 
pared pixel values are converted to Intermediate values in Image memory (i.e., the Intermediate values of previously 
compared Image memories are checked). When the comparison of the modified Image of the test fingeqsrint and the 
45 modified image of the registered fingerprint using one set of values {S, H, V} Is completed, the modified Image of the 
test fingerprint Is returned to Its original state using the Information placed Into the woridng area of memory. 

StepWSc : 

so [0207] When step W3b has been completed for all of the addresses of the aggregations of (Xro.Yro). 
55 is calculated, and N„, and T for this {S.H.V} are memory stored. 
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Step W4 (Parallel displacement according to H and V) 

[0208] For the black pixel address (Xq .Yq) of the new registered fingerprint when H=V=0, H and V, which have been 

set In the H, V storage area are selected In sequence (when H=V=0, cateulatlon has already been completed In step 
5 3). When the values of H from Its minimum value to Its maximum value and the values of V from Its minimum value to 
Its maximum value are changed sequentially by each Increment (I.e., the minimum value of H Is H^^, the maximum 
is H„^, when the incremental value is Kh, the value of H changes according to H = H„h,(lh), H„|n(lh)4.Kh,... until the 
maximum K^ax is reached; the minimum value of V Is V„,n, the maximum is V^^x. when the Incremental value is Kh, 
the value of H changes according to V=Vn„n. V^^^+Kv,.. .), (Xe-H, Y^-V) becomes the black pixel address aggregation 
10 of the new registered fingerprint following parallel displacement, hence processing Identical to step W3 is carried out 
for each set of {S,H,V}. 

Step W5 (Check of unprocessed S): 

15 [0209] When a value of an unprocessed S Is present, the procedure returns to step W1 ; When a value of an unproc- 
essed S Is not present, the procedure moves to step W6. 

Step W6 (Judgment of the maximum degree of concordance): 

20 [0210] For each (S.H.V). according to each value of S and each (S.H.V) according to the change in H=H^,n--'H„ax, 
^'^miiC^max' values of S, H, and V, and the values of T, and are cateulated as the output infonnatlon for 
the case when T= / N^. reaches a maximum. Even when only one value for each of S, H, and V, respectively, is 
inputted, T, N„ and are designated as the output Infomiation. 
(End of procedure W) 

25 [0211] FIG. 16A Is a diagram for explaining an example of the neighboring pixel search In the comparison process. 
FIG. 16B, with regard to the black pixel address A of the registered infonnation from a registered fingerprint, shows 
cases: (1) when address A of the modified image of the test fingerprint is a black pixel, address A of the modified image 
of the test fingerprint and address A of the modified image of the registered fingerprint are totally concordant; and (2) 
when address A of the modified Image of the test fingerprint Is jiot a black pixel, e.g., when address B of the modified 

30 image of the test fingerprint Is a black pixel, address A of the modified Image of the test fingerprint and address A of 
the modified image of the registered fingerprint are approximately concordant. In addition. FIG. 1 6B shows the recip- 
rocal relatfonship of concordance and approximate concordance; an overiap check is performed in order to prevent 
the overiap of black pixel of the modified image of the test fingerprint, which has already been compared once as truly 
or approximately concordant, from the black pixel address of the modified image of another registered fingerprint. 

3S [021 2] In other words, black pixel a of the modified bnage of the registered fingerprint Is totally concordant with black 
pixel d of the modified Image of the test fingerprint; black pixel b of the modified image of the registered fingerprint is 
approximately concordant with black pixel e of the modified Image of the test fingerprint; and black pixel c of the modified 
Image of the registered fingerprint is discordant with the modified image of the test fingerprint. When checks for total 
concordance and approximate concordance are perfomied, It is designed such that neither black pixel d nor black 

40 pixel e, both of which have already been compared, is overiapped and designated again as concordant. 

[021 3] Furthemiore. It is possible to designate the search range forjudging approximate concordance by considering 
four or eight neighboring pixels, taking into consideration the distortion state of the Image at Input, etc. 
Remarks W(1 ): The value of (1=1 .2,...k) in step W3b is 0 ^ S 1 , however it is possible to determine this value, 
for example, as described in the following. When total number of black pbceis of a modified image of a registered 
fingerprint Is set to N^, N^/Nc (1=1 .2,...k) Indteates the progression state of the processing wherein the range is repre- 
sented by 0 ^ N^Ng ^ 1, As Ne, increases and approaches N^, N^/N^,, approaches N^,., which Is the degree of 
concordance with respect to the {S,H,V} cumently being checked, thus it is possible to set such that N^, is as large 
as possible. 

[0214] As increases, the range for midway abandonment also increases. There is a considerable effect on the 
so decrease In the processing amount, however, due to the frequency with whteh en-ors In recognition are generated, It 
is necessary to set an appropriate value for T^. The maximum frequency of this calculatton is detemiined according 
to the set value of k. If midway abandonment of a comparison Is canied out one time, the cateulatlon for the possibility 
of midway abandonment for the values of {S,H,V} after that point is not necessary. In addition, it is necessary to set a 
concrete value of T^, according to the characteristics of the desired Image. Furthermore, If the condition expression 
S5 defining the range of the midway abandonment of the comparison also defines the degree of concordance up to that 
point; this condition expression Is not limited to the example shown In procedure W. Remarks W(2): TTie method of 
step W2 signifies the following. For all the addresses (Xh,Yr) in step W2. the new address following parallel displace- 
ment to align the approximate center point (X^c. Yrc) of the registered fingerprint concordant to the approximate center 
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point (X-ix^iYtc) of the test fingerprint is as follows: 



(^#> Yr#) then f onns the new address. Subsequently, coordinate axis rotation of S degrees Is canied out about (Xjq, 
Yjq). This may be obtained according to the following: 

Xro = (Xr# - Xtc) • cos(S) 4- (Yr# - Ytc) • sin(S) + X^ 
= (Xr - Xrc) • cos(S) 4- (Y„ . Yrc) • sln{S) + X^ 

Yro - -(Xr# - Xtc) • sin{S) + (Yr, - Y^) • cos(S) + Y^ 
= -(Xr - Xrc) • sin{S) + (Yr - Yrc) • cos(S) + Y^c 

(it is possible to maintain the values of the variable range of the predetemiined angle S by means of the values of the 
sin(*) and cos(«) trigonometric functions.) 

(14) Flow of Registration Processing and Comparison Processing 

[0215] FIG. 17 is a flow diagram showing an outline of the registration processing and the comparison processing 
of a fingerprint. The registration process is the pmcess of registering the registration Infomnation of a fingerprint in 
memory 6 of image processing unit 1 . The comparison process Is the process of judging the concordance of a test 
fingerprint and a registered fingerprint. A flow chart outline from input of the fingerprint up until the registration or 
comparison process Is shown in the following procedure Z. 

(Procedure Z) 

[0216] Steps ZA1 ZA5 represent the processes common to both the registration processing and comparison 
processing. 

Step ZA1 : 

[0217] input of a fingerprint from image input device 2 into image memory 4. 
Step ZA2 : 

[0218] Smoothing of the gray-scale Image of the fingerprint in Image 1 0 of image memory 4. 
Step ZA3 : 

[0219] Binary conversion and baclcground segregation of image 10 by means of procedure B. 
Step ZA4 : 

[0220] Calculation of the approximate center point of the fingerprint Image in Image 1 0. 
(End of steps ZA1 -ZA4) 

[0221] The following processes are separated Into registration processing and comparison processing. 

[0222] Steps ZR1 ~ ZR2 are applied during the registration process; these steps record the registered information 

of the registered fingerprint Into memory 6. 
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Step ZR1 : 

[0223] Narrow processing within the fingerprint area is canied out on the binary Image (prinnaiy Innage) of the reg- 
istered Image In image 10, and a modified Image of the registered fingerprint (primary modified image) is obtained. 

5 

Step 2R2 : 

[0224] The processing of registered infomnation of the registered fingerprint is canied out (procedure R). 
(End of steps ZR1 -ZR2) 

10 [0225] Steps ZC1 ZC2 are applied during the comparison process; these steps perform the comparison of the 
test fingerprint and the registered fingerprint 

StepZCI : 

15 [0226] Blacic pixel ratio standardization or narrowing of the fingerprint area of the binary Image of the test fingerprint 
(secondary image) In Image 10 is performed, and a modified Image of the test fingerprint (secondary modified image) 
is obtained. It is not necessary to repeat standardization of the blaclc pixel ratio In the case when this process has been 
perfonned in step ZA3. 

20 step ZC2 : 

[0227] Judgment is made on the concordance of the registered fingerprint and the test fingerprint by means of the 
aforementioned comparison processes (procedure C, procedure W). 
(End of steps ZC1 - ZC2) 

25 [0228] in the registration processing of the image, a plurality of images can be sequentially Inputted and maintained. 
These Images are then compared, and the image with the best concordance can be selected as the image for regis- 
tration. FIG. 18 is a flow diagram showing an outline of this registration process by means of which the optimum 
registered fingerprint Is selected from among a plurality of input bnages. An example of this procedure is shown by 
procedure RR. 

30 

(Procedure RR) 
Step RR1 : 

35 [0229] The fingerprint Image is inputted into Image memory, and. the inputted fingerprint image is stored in a file. 
This operations is repeated a specified number of times (note: In this example, this specified number is 3 times; the 
files containing the fingerprint images are designated, for example, z1 , z2 and z3.). 

Step RR2 : 

40 

[0230] With regard to the plurality of inputted images, a comparison process is conducted in accordance with the 
following combinations; when concordance is detected, the degree of concordance T2 of each template is recorded 
Into memory, 

[0231] During this comparison process, at the time when a comparison discordance is generated, the registration 
45 process Is abandoned, and the procedure Is re-executed from step RR1 . 

[0232] When the comparison of registered fingerprint z1 and test fingerprint z2 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q^2- 

[0233] When the comparison of registered fingerprint z1 and test fingerprint z3 results in a final Judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as 0^3. 
50 [0234] When the comparison of registered fingerprint z2 and test fingerprint z1 results in a final Judgment of con- 
cordance, the degree of concordance T2 of the template Is calculated and set as Qg^ . 

[0235] When the comparison of registered fingerprint z2 and test fingerprint z3 results, in a final Judgment of con- 
cordance, the degree of concordance T2 of the template Is calculated and set as 023. 

[0236] When the comparison of registered fingerprint z3 and test fingerprint z1 results In a final Judgment of con- 
55 cordance, the degree of concordance T2 of the template is calculated and set as . 

[0237] When the comparison of registered fingerprint z3 and test fingerprint z2 results in a final Judgment of con- 
cordarice, the degree of concordance T2 of the template is calculated and set as Q32. 

[0238] The number of final Judgments of concordance must meet specified conditions (e.g., when the comparison 
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process is conducted six times, as described above, specified conditions requiring, for example, at least four final 
ludgments of concordance may be designated.). 

[0239] Subsequently, the average degree of concordance is calculated for each Input image. For example, In the 
case when all of the aforementioned comparisons are concordant, 

5 

for z1 . average degree of concordance 

Ql=(Qi2 + Qi3)/2: 

10 

for z2, average degree of concordance 

Q2 = (Q2, + Q23)/2; 

15 

and 

for z3, average degree of concordance 
^ Q3 = (Q3,+Q32)/2, 

Step RR3 : 

[0240] The maximum Qi is calculated from among the average degrees of concordance Ql = {Q1 , Q2, Q3}, and is 
25 registered using the registration infonnation of fingerprint zi con^esponding to the i above. 
(End of procedure RR) 

[0241] The number of input Images at the time of registering one fingerprint may be an optionally designated value 
of at least one. Increasing the number of input images increases the possibility of selecting a high quality image as the 
registered fingerprint image, however, this also results in an Increase In the registration processing amount, thus the 
30 number of input images is detennined by considering a balance between these aspects. The selection of combinations 
for the comparison of reciprocal regions of the input images is not limited to the above description, as it is also possible 
to select only a portion of the aforementioned combinations as well. The process for selecting the fingerprint images 
for registration is also not limited to the aforementioned use of the average degrees of concordance, as ottier methods 
are also possible. 

35 

(15) Comparison of 1 to N 

[0242] The comparison process described In the aforementioned embodiments Judges whether or not one test fin- 
gerprint is concordant with the registered Infomiation of one registered fingerprint. Using this comparison process, in 
40 order to judge whether or not one test fingerprint is concordant with at least one registered information from among 
an optional number of registered information, it is clear that the comparison process must be sequentially perfonmed 
with regard to each registered Infonnation until a Judgment of concordance results. However, a drawback exists In this 
process In that increasing the number of registered infonnation results In an increase In the processing amount for 
comparison. 

45 [0243] From among an optional number of registered Information, when one registered information which is con- 
cordant with one test fingerprint is discovered, the following procedure NA can be executed. FIG. 19A shows the 
relationsh^ between ttie test fingerprint and registered fingerprint; FIG. 19B Is a flow diagram showing an outilne of 
this aforementioned 1 to N comparison process. 

50 [Procedure NA] 

[0244] The partial Interval of {S,H,V} is divided into first, second, nth partial segments. The original segment {S, 
H,V} is accordingly the aggregate sum of all partial segments. The partial segments may be provided independently 
from the partial alignment intervals, or optionally may utilize the partial alignment Inten/als. A simple example of a 
55 partial segment Includes selecting a segment In which concordance occurs frequently (e.g., {&=0, H=H^~H^, 
V^Vmin-- as the first partial segment, and then selecting a partial segment other than this first partial segment. 
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(Procedure NA) 
StepNAI : 

[0245] Input of test fingerprint. 
Step NA2 : 

[0246] Sequential selection of partial segments. 

:[0247] In the comparison of the first partial segment, the comparison of a test fingerprint with registered information 
(I = 1 , 2, n) Is perfomried with respect to the first segment {S.H.V} until concordant registered Information Is discov- 
ered. When It is not possible to find concordant registered Infonmation among the registered Information processed in 
the first comparison, the procedure proceeds to the second comparison. 

[0248] in the comparison of the second partial segment, the comparison of a test fingerprint with registered Informa- 
tion (I = 1 , 2, .... n) Is perfomried with respect to the second segment {S.H.V} until concordant registered Infomiatlon Is 
discovered. When ft Is not possible to find concordant registered infonnatlon among the registered infomiation proc- 
essed In the second comparison, the procedure proceeds to the third comparison. 

[0249] This comparison procedure continues, as described above, until a concordant registered fingerprint Image is 
discovered. The procedure ends when a concordant registered fingerprint Image is discovered. In the case when a 
concordant registered fingerprint image cannot be found, the procedure ends after processing the last partial segment. 
(End of procedure NA) 

[0250] With regard to the test fingerprint and concordant registered infomiation, according to this above-described 
procedure, the processing amount for comparison up until the discovery of concordant registered Infomiation can be 
significantly reduced. 

(16) Substitution of the degree of discordance 

[0251] During the comparison process, it Is possible to use the following process in place of judging the aforenrten- 
tioned degree of discordance. 

[0252] When comparing a binary image for registration and a binary image for testing (binary test image), the reg- 
istration infomnation of the aforementioned binary image for the registration, and the Image of the registration informa- 
tion in which the blackAvhite pixels of the aforementioned binary Image for the registration have been reversed (reverse 
registered Image) are separately registered; the concordance of the binary test image and the registered Infomfiation 
are compared; and the concordance of the reverse image of the binary test Image and the reverse registered image 
of the registered Information are compared. When the final Judgments of the aforementioned two comparisons both 
indicate concordance, the binary image for registration and the binary test image are judged to be concordant, and the 
chedc using the degree of discordance (e.g., degree of discordance) can be omitted. However, when selecting this 
procedure, although caiculatfon of the degree of discordance can be omitted, drawbacks exist in that the registration 
amount and comparison time both increase. An example of the process relating to the registration procedure is shown 
by procedure RVR. An example of the processing relating to the comparison procedure is shown by procedure RVM. 

(Procedure RVR) 

StepRVRI : 

[0253] The registration process is performed on a fingerprint for registration, and the registration infomiation therein 
is registered. 

Step RVR2 : 

[0254] At the time of binary conversion of the registered fingerprint, the black and white pixels are reversed, following 
¥vhich the registration process is performed on this binary ^age (refenred to as "reverse binary registered image"), 
and the reverse registered infomiation of the above registered fingerprint is then registered. 
(End of procedure RVR) 
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(Procedure RVM) 
StepRVMI : 

5 [0255] A test fingerprint and registered fingerprint are compared using a comparison process. At this point, the check 
of the degree of discordance is omitted. 

Step RVM2 : 

10 [0256] The white and black pixels are reversed when perfomnlng binary conversion of a test fingerprint, and this 
binary image (referred to as "reverse binary test image") is then compared with the reverse registered infomiation of 
a registered fingerprint by means of a comparison process. At this point, the check of the degree of discordance Is 
omitted. 

(End of procedure HWM) 

IS [0257] FIG. 20A Is a flow diagram showing an example of the process relating to the registration procedure; FIG. 
20B is a fk>w diagram showing an example of the process relating to the comparison procedure. 

(17) Expansions and Modiftoations 

20 [0258] The present Inventfon Is not limited to the aforementioned embodiments, as it Is possible to apply, for exanpie, 
the following expansions and modifications. The methods of calculating the degree of concordance and degree of 
discordance in the image input method, smoothing process, binary conversion process, background segregation proc- 
ess, correction process, process for calculating an approximate center point, thinning or nan^owlng process, and com- 
parison process are not limited to the descripttons contained In the embodiments and claims of the present Invention, 

25 as modifications, expansions and^or partial omissions utilizing other methods (e.g., conventtonai methods) may also 
be employed. The method of designating the X and Y-coordinates Is similariy optional. In alignment, when the drift In 
the rotation is small enough to be Ignored, it is possible to check only those potential positional errors In parallel dis- 
placement, and to Judge the maximum degree of concordance from this degree of concordance. 
[0259] In step W2 of procedure W, when the conversion whteh carries out rotational and parallel displacement is 

30 perfomied, the expresston for obtaining X^q and Y^q may be utilized. However, this is not limit to the embodiments 
of the present invention in any manner. For example. It is also possible to utilize the following: 

Xr^ = Xr • cos(S) + Yr • sln(S) 

35 

YRo=-XR*sln(S)+Yf,*cos(S) 

Furthermore, the utilization of coordinate conversion or geometric transfomriation is similariy not limited to the afore- 
40 mentioned. The processing quantity necessary for comparison can be reduced due to the addition of a value for canying 
out rotational and parallel displacement of the sut>-tempiate as registered Infomfiatlon (in this case, the memory quantity 
increases). 

[0260] In the embodiments of the invention of the present invention, the case in whrch the image is a fingerprint is 
disclosed, however, the present invention can be appropriately applied to any Image whbh Is constructed from lines. 
45 The classification of the sub-template and non-sub-template is not limited, and. expansions such as classifying neither 
or setting many classifications are also possible. In addition, It Is also possible to Individually select one or more of the 
aforementioned processes and respectively apply them to an optional image processing apparatus. 

Results of the Invention 

50 

[0261] In the present Invention, the capabilities of an Image processing apparatus In the recognition of a fingerprint 
or image similar to a fingerprint can be improved by means of selecting and applying at least one of the means and/ 
or processes described in the aforementioned embodiments. Hie main results of the present inventton are summarized 
below. 

. 55 

(1) In the comparison of registered information and a test Image, during the binary conversion process, the flue- 
tuatton of the inputted gray-scale image Is offset by means of standardizing tiie ratio of black pixels of the test 
image to a specified range, and hence ttie precision of the comparison Judgment can be increased. In addition, by 
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means of appropriately setting the specified range of the black pixel ratio, degree of concordance and degree of 
discordance, the recognition error rate (i.e., the probability of mistaldng another individual's fingerprint as the fin- 
gerprint of the person in question, or vice versa) can also be reduced. 

(2) At the time of binary conversion following division of the image Into a plurality of partial regions, the discontinuity 
of the binary image generated at the boundaries of the partial regions can be reduced by means of modifying the 
average brightness value of the partial regions using the reciprocal relationship of the partial regions, and by 
perfonmlng binary conversion using this modified average brightness value. 

At the time of binary conversion following division of the image into a plurality of partial regions, within a partial 
region, by means of binary converting a partial region possessing an average brightness value within a first spec- 
ified range and a brightness modification amount within a second specified range using a threshold value deter- 
mined with regard to all regions of the image, the noise effects of an image, generated upon using the image input 
unit, to the binary image following binary conversion can be reduced during binary conversion of a minute variable 
portion of the brightness. 

In the binary conversion in which the binary conversbn process is repeated to standardize the ratio of black 
pixels following modification of the br^htness threshold value for binary converston, with regard to nonuniformity 
and fluctuation of the brightness of the input image, it Is possible for the ratio of black pixels to approach the 
threshold value which results in the ability to cleariy define fingerprint lines, as well as reduce the fluctuation of the 
line widths, 

(3) By dividing a displacement Interval of at least one direction into a plurality of partial intervals to form partial 
alignment intervals over a displacement range in whteh alignment comparison occurs, the processing amount for 
comparison can be significantly reduced when a final judgment of concordance results during sequential compar- 
ison of the partial alignment intervals, since the comparison process need is not conducted on the remaining partial 
alignment intervals following the interval in which a judgment of concordance of both images was rendered. 

In addition, the processing amount for comparison can be further reduced since in the aforementioned partial 
alignment intervals (1 , 2. n), when a maximum value of the degree of concordance falls outside of a specified 
range, a judgment of discordance is rendered without processing the remaining partial alignment intervals. 

(4) In the case where a random address A In the memory of the registered image is a black pixel, and the address 
A in the memory of a test image Is a white pixel, when a predetermined number of neighboring addresses of 
address A of the test Image are searched and a black pixel exists, the black pixel of address A of the test image 
is judged to be concordant with the black pixel of address A of the registered Image; and in subsequent comparison 
of the above registered image and test Image judgments regarding the concordance of black pixels from other 
addresses of the registered image which overiap black pixel of address A of the test Image. Therefore the fluctuation 
in the distortion of the lines of an image can be effectively countered by checking the neighboring information of 
a black pixel of a registered image in the above-described manner. 

(5) In the case where an optional check of the portions con^espondlng to sweat glands of a finger is selected, during 
comparison processing of the registered image and test image, when a hole Is detected in the test image, all 
registered holes are examined for concordance with this hole, and when the number of concordant registered 
holes exceeds a predetermined ratio, a judgment of concordance is rendered with regard to the registered image 
and test image. As a result, an extremely strict comparison can be performed. 

(6) In the case when, upon comparing a test image and registered information, as well as a reverse test image (in 
which the brightness of the original test image is reversed) and reverse registered Infonnation, both of these com- 
parisons produce successful results, a Judgment of concordance Is rendered with regard to the registered Image 
and test Image. As a result, calculation of the degree of discordance can be omitted. 



Claims 

1 . A method for processing images for comparing a test image with one or more registered Images and for judging 
whether said test image is originated from the same object as one of the registered images, and comprising 
processing steps of : 

a) storing a registered image in an image memory ; 

b) binary converting (B1 ) said registered image Into a binary registered image by using each brightness value 
of each pixel of said registered image, and said binary converting includes: 

c) detemiining (81 c) whether a ratio of a total number of black pixels to a total number of black pixels and 
white pixels in said binary registered image is within a first predetermined range ; and if said ratio is not within 
the first predetermined range, starting again step b) and step c) by changing one or more threshokJ values 
until a binary registered image has said ratio within the first predetemiined range ; 
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and further comprising : 

d) thinning said binary registered Image to obtain a thinned binary registered Image, 

e) storing and binary converting a test image in the same manner as said registered image and obtaining a 
binary test image ; 

f) comparing (CO, C 1 , C2) said thinned binary registered Image and said binary test Image to detemnlne whether 
said binary test image is originated from the same object as said registered image, 

and said comparing includes: 

g) detennining (W3b) that a black pixel of said thinned binary registered image is concordant with a pixel of said 
binary test Image, either when a brightness value of said biacic pixel of said thinned binary registered image having 
an address is concordant with a brightness value of said pixel of said binary test image having a corresponding 
address, or is concordant with a brightness value of a neighboring pixel of said pixel of said binary test image ; 
and further comprises, 

h) Judging (C5) whether a degree of concordance between said binary test image and said thinned binary registered 
Image satisfies a predetemriined condition of concordance, and detennining whether said binary test Image is 
originated from the same object as said registered image according to said degree of concordance. 

An image processing apparatus storing one or more registered images, and comprising : 

means for binary converting (B1 ) a registered image into a binary registered image, wherein said means for 
binary converting determines (Bic) whether a ratio of a total number of biack pixels to a total number of black 
pixels and white pixels in said registered image is within a first predetennined range, and if said ratio Is not within 
the first predetennined range, said binary converting means reconverts said registered image by changing one or 
more threshold values until a binary registered image has said ratio within the first predetennined range ; 
and further comprising : 

means for thinning said binary registered image ; 

means for binary converting a test image In the same manner as said registered image ; 
means for comparing (CO, CI , C2) said thinned binary registered image and said binary test image to detennlne 
whether saki binary test Image is originated from the same object as said registered image, wherein said 
means for comparing is characterized by, 

means for detenrnining (W3b) that a black pixel of said thinned binary registered image is concordant with a 
pixel of said binary test Image, either when a brightness value of a black pixel of said thinned binary registered 
Image having an address Is concordant with a brightness value of said pixel of said binary test image having 
a corresponding address, or is con^espondent with a brightness value of a neighboring pixel of said binary test 
image ; ' 

and further comprising, 

means forjudging (C5) whether a degree of concordance between said binary test image and said binary 
registered image satisfies a predetennined condition of concordance ; and determining whether sakJ binary test 
image is originated from the same object as said registered image according to said degree of concordance. 

An Image processing apparatus as claimed In claim 2, further comprising, 

means (IN) for fixing a test image during inputting from an image Input to an Image memory, 

including means (IN) forjudging inputted images to be vaiid when the average brightness value for each of a 

predetennined number of one or more image regions is within a predetennined range, and 

means (ET) for modifying 

the Inputted image Into a modified image having a required number of pixels for comparing processing. 

An ^age processing apparatus »xx>rding to claim 2, in whk:h said means (81) for binary converting comprises 

means for dividing (81 a) said test Image into a plurality of partial regions, 

means (81 b) for obtaining an average brightness for each of the plurality of partial regions, . 

means (81 c) for determining a threshold brightness value for each of the plurality of partial regions and for 

converting said test image into a binary test image with reference to the threshold brightness value of each 

said partial region and of regions neighboring each said partial region, and means for obtaining the ratio of 

the total number of black pixels to the total number of black pixels and white pbcels, 
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and means (Bic) for repeating said binary conversion of said test image to change said threshold brightness 
vaiue until said ratio of black pixel to the total number of black pixels and white pixels is within the first prede- 
temiined range, and the binary test Image obtained after repeated conversion is used for comparison with 
said binary registered image. 

5 

5. An image processing apparatus according to dalm 4. further comprising : 

means (B1 b) for determining said threshold brightness value of a partial region with reference to said average 
brightness value (Bav(x,y))) of said partial region and at least one average brightness of at least one neighboring 
partial region. 

10 

6. An image processing apparatus according to claim 4, in which said threshold brightness value of a partial region 
is determined to be equal to a predetemiined vaiue if said average brightness value (Bav(x,y)) of said partial region 
lies within a predetermined range and each absolute difference value between said average brightness vaiue and 
each brightness value (f(x,y)) of each pixel of said partial region lies within a predetermined range. 

15 

7. An image processing apparatus according to claim 2, wherein said means (Cg C3) for comparing further determines 
a degree of discordance between said binary test image and said binary registered image by detecting discordance 
of black pixels of said binary test image after thinning and black pixels of said registered image, and compares 
said degree of discordance with a predetermined value. 

20 

8. An Image processing apparatus according to claim 2, further comprising means for storing (R) image data including 
means for compressing and recording (G) Image data as a compressed address Infonnation of black pixels in a 
plurality of pixel aggregations of a valid image, 

wherein said compressed address infonnation comprises a position on the X>axis of black pixels in a pixel 
25 aggregatton, a code and a format Identification data of respective pixel aggregatk>n. 

. 9. An image processing apparatus according to claim 2, in which said means (CO, CI ) for comparing said thinned 
binary registered image and said binary test Image Includes a means (CO) for moving at least one of the two binary 
images in one or more intervals in order to compare said two binary images, wherein each said one or more 
30 intervals is divided into a plurality of partial intervals, 

means (C) forjudging whether said binary test Image satisfies a predetennlned condition of concordance and 
discordance with said binary registered image in one of said partial intervals, 

means (C) for successively displacing said one partial interval until said predetemnlned condition of concord- 
35 ance and discordance is satisfied, 

means (C3) for checking discordant sections and 

means (C5) for Judging said binary test image as originating from a same object based on predetemnlned 
condition of concordance and discordance and on the results from the checking means. 

40 1 0. An image processing apparatus according to dalm 2, further comprising means for aligning said binary test innage 
and sakl thinned binary registered Image, 

and wherein said means (0) forjudging furtiier judges whether said binary test image originates from a same 
object as said thinned registered image according to said degree of concordance and a degree of discordance. 

45 11 . An Image processing apparatus according to claim 2, furtiier comprising means for aligning (CO, CI ) said binary 
test image with said thinned binary registered image comprising : 

means (C1 , W) for moving at least one of the two binary Images in one or more Intervals in order to compare 
said two binary images, wherein each said one or more, inten^als is divided into a plurality of N partial Intervals, 
so and 

means for Judging whether said binary test image satisfies a predetennlned condition of concordance with 
said binary registered image in one of said N partial inten^als ; 

means for successively displacing said N partial intervals of an m-th (m is a positive number) order of said 
partiajlntervals ; 

55 means (C, W) for judging that said binary test image originates from a same object as said binary registered 

iniage when said predetemilned condition of concordance is satisfies prior to the m-th order of successive 
displacement ; and 

means (C) forjudging that said binary test Image originates from a different object than said binary registered 
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image when said predetermined condition of concordance is not satisfied until a successive displacement of 
the m-th order of said partial Intervals, so as to carry out rapid comparison by said comparing means. 

12. An image processing apparatus according to dalm 2, further comprising : 

5 

means (WIH) for discovering holes in said binary registered image, each hole being an aggregate of white 
pixels sunrounded by blacic pixels ; 

means (C4) for Judging concordance of said binary test Image and binary registered image wherein a hole in 
said registered Image is detemiined to have a con'esponding hole in said binary test image when addresses 
10 of said two holes satisfy a predetermined relationship, and said two images are regarded to be originated from 

a same object if a number of con^esponding holes between said binary registered image and said binary test 
Image lies within a predetermined range. 

13. An image processing apparatus according to daim 2, further comprising : 

15 

image reversing means (RVR) for obtaining a reverse image of said test image and said stored registered 
image ; 

means (RVR2) for converting said reverse test image and said reverse registered Image Into a binary reversed 
test image and a binary reversed registered image, respectively, so that a ratio of black pixels to total pixels 
^ lies within the first predetermined range ; 

means for storing address infonnation of black pixels of said binary reversed test image and said binary re- 
versed registered image ; 

means (C2, C3) for comparing said binary registered image with said binary test Image for evaluating a first 
degree of concordance ; 

means for comparing the binary reversed test image with said binary reversed registered Image to evaluate 
a second degree of concordance ; and 

means (C5) for determining that the test image and said stored registered image originate from the same 
object if both said first and second degrees of concordance evaluation satisfy respective predetenmlned range. 

30 

PatentansprOche 

1. Verfahren zum Verarbeiten von Bildern zum Vergleichen eines Testblides mit einem oder mehreren registrierten 
Blldem und zum Beurteilen, ob das Testbiid von dem gleichen Objekt wie eines der registrierten Bllder hemihrt, 
35 mit folgenden Schrltten: 

a) Spetehem eines registrierten Blldes in elnem Bildspetoher; 

b) bindres Umwandein (B1) des registrierten Slides In ein binares registriertes Blld mit Jedem Helligkeitswert 
von Jedem Pixel des registnerten Blldes, wobei das binare Umwandein umfaBt: 

40 c) Bestinrvnen (61c), ob ein Vertialtnis einer Gesamtzahl von schwarzen Pixein zu einer Gesamtzahl von 

schwarzen Pixein und welBen Pixein in dem bin&r registrierten Bild in einem ersten vorbestimmten Beretehs 
ist; und, wenn das Verh&itnis nteht in dem ersten vorbestinmten Berek:h ist, emeutes Starten von Schrftt b) 
und Schritt c) durch Andem eines Oder mehrerer Schweilenwerte, bis ein blnSres, registriertes Bild das Ver- 
h&ltnis In dem ersten vorbestimmten Bereich aufweist; 

45 

und femer mit 

d) AusdQnnen des bInSr registrierten Bildes, um ein ausgedunntes binfires, registriertes Bild zu erhaiten; 

e) Spek^hem und bin&res Umwandein eines Testblides auf die glelche Art und Weise wie das reglstrlerte Bild 
so und Ertialten eines binSren Testblides; 

f) Vergleichen (CO, CI , C2) des ausgedQnnten binSren, registrierten Blldes und des biniren Testblides, um 
zu bestimmten, ob das binfire Testbiid von dem glebhen Objekt wie das reglstrlerte Bild herruhrt, 

. und das Vergleichen umfaBt 

^ g) Bestimmen (W3b), daB ein schwarzes Pixel des ausgedQnnten bin§ren, registrierten Bildes mit elnem Pixel des 
binSren Testblides konkordant ist, entweder wenn ein Helligkeitswert des schwarzen Pixels des ausgedQnnten 
binfiren, registrierten Bikies mit einer Adresse mit einem Helligkeitswert des Pixels des binflren Testblides einer 
entsprechender Adresse konkordant ist, oder mit einem Helligkeitswert eines benachbarten Pixels des Pixels des 



41 



EP0623 690B1 



bin&ren Testbildes konkordant ist; 
und femer mtt, 

h) Beurtellen (C5). ob ein Gmd einer Konkordanz zwischen dem bindren Testbiid und dem ausgedQnnten binfiren. 
registrierten Testbiid eine vorbestimmte Konkordanzbedingung erfuitt, und Bestimmen gemaB dem Grad der Kon- 
kordanz, ob das binSre Testbiid von dem gleichen Objekt wie das registrlerte Bitd herruhrt. 

Bildverarbeitungsvorrichtung, die ein odermehrere registrierte Bilderspeichert und aufweist: 

MIttel zum bin§ren Umwandein (B1) eines registrierten Bildes In ein binfires, reglstriertes Bild, wobei das 
Mittet zum binflren Umwandein bestimmt (Bic), ob ein Verhfiltnis eIner Gesamtzahl von schwarzen Pixefn zu einer 
Gesamtzalil von schwarzen Pixein und welBen Pixefn In dem registrierten Bild In einem ersten vorfoestimmten 
Berelch Ist, und, wenn das Verhallnis nicht in dem ersten vorbesttmmten Bereich Ist, das binare Umwandlungsmlttel 
das registrierte Bild emeut durch Andem eines oder mehrerer Schwellenwerte umwandelt, bis ein bindres regl- 
striertes Bild das Verhdltnls In dem ersten vort^estimmten Berelch aufweist; 
und femer mit: 

Mittel zum Ausdunnen des binaren, registrierten Bildes; 

Mittel zum binfiren Umwandein eines Testbildes auf die glefche Art und Welse wie das registrierte Bild; 
Mittel zum Vergleichen (CO, CI , C2) des ausgedunnten binaren, registrierten Bildes und des binaren Testbil- 
des, um zu bestlmmten. ob das blndre Testbiid von dem gletehen Objekt wie das registrierte Bild herrClhrt, 
wobei das Mittel zum Vergleichen gekennzeichnet ist durch 

Mittel zum Bestimmen (W3b), das ein schwarzes Pixel des ausgedQnnten binaren, registrierten Bildes mit 
einem Pixel des binfiren Testbildes ubereinstimmt, entweder, wenn ein Helligkeitswert eines schwarzen Pixels 
des ausgedQnnten blnflren, registrierten Slides mit eIner Adresse mit einem Helligkeitswert des Pixels des 
binaren Testbildes eIner entsprechenden Adresse konkordant Ist, oder einem Helligkeitswert eines benach- 
barten Pixels des binfiren Testbildes entspricht; 

und femer mil 

Mittel zum Beurtellen (C5), ob ein Grad einer Konkordanz zwischen dem binfiren Testbiid und dem binfiren, 
registrierten Testbiid eine vori^estimmte Konkordanzbedingung eriullt; und zum Bestimmen gemfiB dem Grad der 
Konkordanz, ob das binare Testbiid von dem glebhen Objekt wie das registrierte Bild hentjhrt. 

Bildverari^eitungsvorrtehtung gemfiB Anspruch 2, ferner mit, 

Mittel (IN) zum Fixieren eines Testbildes wfihrend einer Eingabe von einer Bildelngabe in einen Bildspeicher, 
welches Mittel (IN) zum Beurtellen eingegebener Bilder als gultig umfaBt, wenn der durchschnittliche Hellig- 
keitswert in einem vori^estimmten Bereich ist, und 

Mittel (ET) zum Modlfizieren des eingegebenen Bildes In ein modlflziertes Bild. das eine erforderitohe Anzahl 
von Pixein zur Vergleichsverarbeitung aufweist. 

Blldverarbeitungsvorrichtung gemfiB Anspruch 2, bei der das Mittel (B1) zum binfiren Umwandein umfaBt: 

Mittel zum Aufteilen (B1 a) des Testbildes In eine Mehrzahl von Tellregionen, 
Mittel (Bib) zum Erhalten einer durchschnlttlichen Helligkeit fur jede der Mehrzahl von Tellregionen, 
Mittel (Bic) zum Bestimmen eines Schwellenhelligkeltswert fQr jede der Mehrzahl von Tellregionen und zum 
Umwandein des Testbildes In ein binares Testbiid mit Bezug auf den Schwellenhelligkeltswert jeder der Tell- 
regionen und der jeder Tellreglon benachbarten Regionen, und Mittel zum Eriialten des Veriifiltnisses der 
Gesamtzahl von schwarzer Pixein zu der Gesamtzahl von schwarzen Pixein und weiBen Pixein. und 
Mittel (B1c) zum Wiederholen der binfiren Umwandlung des Testbildes, um den Schwellenhelligkeltswert zu 
findem, bis das Vertifiltnis von schwarzen Pixein zu der Gesamtzahl von schwarzen Pixein und weiBen Pixein 
In dem ersten vortestimmten Bereich Ist, wobei das nach der wiedertiolten Umwandlung ertialtene Testt)ild 
zum Verglebh mit dem binfiren registrierten Bild veiwendet wlrd. 

Bildveraribeitungsvonrichtung gennSB Anspruch 4, femer mit: 

Mittel (Bib) zum Bestimmen des Schwellenhelligkeitswerts einer Teiiregion mit Bezug auf den durchschnltt- 
lichen Helligkeitswert (Bav(x,y)) der Teiiregion und mindestens einer durchschnlttltehen Helligkeit von mindestens 
einer benachbarten Teiiregion. 

Blldverarbeitungsvorrichtung gemfiB Anspruch 4, bel der der Schwellenhelligkeltswert einer Teiiregion bestimmt 
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wird, urn glelch elnem vorbestlmmlen Wert zu sein, wenn der durchschnlttliche Helllgkeitswert (Bav(x,y)) der Teil- 
reglon in elnem vortestinvnten Berelch llegt und jeder DJfferenzbetragswert - zwischen dem durchschnlttltehen 
Helllgkeitswert und jedem Helllgkeitswert (f(x,y)) Jedes Pixels der Tellreglon - In elnem vorbesllmmten Bereteh llegt. 

7. Bildverarbeitungsvon-fchtung gemaB Anspruch 2, bel der das Mittel (2, 3) zum Vergleichen femer einen Grad einer 
Dlskordanz zwischen dem blnftren Testblid und dem binaren, reglstrierten Bild durch Erfassen clner Dlskordanz 
von schwarzen PIxeIn des blnSren Testblldes nach Ausdunnen und schwarzen Pixein des reglstrierten BikJes 
bestimmt und den Grad der Dlskordanz mit elnem vorbesllmmten Wert vergleteht. 

8. Blldverarbeltungsvorriclitung gemSB Ansprucli 2, femer mIt Mittel zum Spelciiem (R) von Bllddaten, welches Mittei 
zum Komprimieren und Aufeelchnen (G) von Bilddaten als eine komprimierte Adresseninf ormation schwarzer Pixel 
In eIner Mehrzahi von Pixel-Aggregationen eines gQltigen Blldes aufweist, 

wobei die komprimierte Adresseninfomiation eine Position auf der X-Achse von schwarzen PIxelh In einer 
Pixel-Aggregatk>n. eInen Code und Fomnat-ldentifikationsdaten der jeweiligen Pixel-Aggregation umfaBt. 

9. Biidverarbeitungsvonichtung gemfiB Anspruch 2, bei der das MIttel (CO, C1 ) zum Vergletehen des ausgedunnten 
binaren, reglstrierten Bildes und des binaren Testbildes ein Mittei (CO) zum Bewegen mindestens eines derbeiden 
binaren Biider in einem oder mehreren Intervailen aufweist, urn die belden binaren Bilderzu vergleichen. wobei 
jedes der eIn oder mehreren Inten^ailen in eIner Mehrzahi von Tellintervallen aufgeteitt 1st, 

Mittei (C) zum Beurtellen, ob das blnSre Testbifd eine vorbestlmmte Bedingung einer Konkordanz und Dlskor- 
danz mit dem binaren reglstrierten Blld in einem der Teliintervalle erfulit, 

Mittei (C) zum aufelnanderfolgenden Verschleben des eInen Teillntervails, bis die vorbestlmmte Bedingung 

der Konkordanz und Dlskordanz erfuilt ist, 

Mittei (C3) zum PrOfen nicht Gbereinstimmender Abschnitte und 

MIttel (C5) zum Beurteiien des binaren Testbildes als von einem glelchen Objekt heniihrend basierend auf 
einer vortsestimmten Bedingung einer Konkordanz und Dlskordanz und auf den Ergebnissen von dem Pruf- 
mittel. 

10. BHdverarijeltungsvorrichtung gemaB Anspruch 2, femer mit Mittei zum Ausrichten des binSren Testbildes und des 
ausgedOnnten bInSren reglstrierten Bildes, 

und wobei das Mittei (C) zum Beurteiien welter gemSB dem Grad der Konkordanz und elnem Grad von 
Dlskordanz beurteilt, ob das binare Testbild von einem giefchen Objekt wie das ausgedunnte. registrierte Biki 
herruhrt. 

1 1 . Biidverarbeitungsvorrichtung gemaB Anspruch 2. f erner mit Mittei zum Ausrichten (CO, CI ) des binaren Testbildes 
mit dem ausgedOnnten binSren, reglstrierten Bild mit: 

Mittei (CI , W) zum Bewejgen mindestens eines der beiden binaren Biider in einem oder mehreren Inten/alien, 
um die beiden binaren Biider zu vergleichen, wobei jedes der ein oder mehreren Intervalle In eine Mehrzahi 
von N Tellintervallen aufgetellt ist, und 

MIttel zum Beurteiien, ob das blnfiro Testbild eine vorbestlmmte Konkordanzbedingung mit dem binfiren re- 
glstrierten Bild in einem der N Teliintervalle erfuilt; 

Mittei zum aufelnanderfolgenden Verschleben der N Teliintervalle von einer m-ten (m Ist eine positive Zahl) 
Ordnung der Teliintervalle; 

Mittei (C, W) zum Beurteiien, daB das bindre Testbild von einem glelchen Objekt als das binfire. registrierte 
Blld hentlhrt, wenn die vori^estlmmte Konkordanzbedingung vor der m-ten Ordnung der aufelnanderfolgenden 
Verschlebung erfuilt 1st, und 

Mittei (C) zum Beurteiien, daB das binare Testbild von einem unterschiedlfchen Objekt als das binare regi- 
strierte Blld herttihrt, wenn die vorbestlmmte Konkordanzbedingung bis zu einem aufeinanderfolgendes Ver- 
schleben der m-ten Ordnung der Teliintervalle nicht erfOIlt Ist, um so eInen schnellen Verglelch durch das 
Vergletehsmlttel durchzufOhren. 

12. BlWverarbeltungsvon-lchtung gemaB Anspruch 2, fernermlt: 

Mittei (WH) zum Entdecken von Ldchem in dem binaren, reglstrierten Bild, wobei jedes Loch eine Aggregation 
von von schwarzen PIxeIn umgebenden weiBen PIxeIn ist; 

MIttel (C4) zum Beurteiien der Konkordanz des blnfiren Testbildes und des bln&ren, reglstrierten Bildes, wobei 
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bestlmmt wird, daB ein Loch In dem registrierten Blld ein entsprechendes Loch In dem blnflren Testblld auf- 
zuweisen hat, wenn die Adressen der beiden Ldcher eine voitestimmte Bezlehung erfClllen, und die beiden 
Bllder als von etnem gleichen Objekt herrOhrend angesehen werden, wenn eine Anzahl entsprechender Ldcher 
zwlschen dem bindren. reglstrieiten Bild und dem binSren Testbild In einem vortestlmmten Bereich liegt. 

13. Blldverarbeitungsvonichtung gemdB Anspmch 2, femermit: 

Blldumkehnnittel (RVR) zum Erhaiten eines Umlcehrbildes desTestbildes und des gespeicherten. registrierten 
Bildes; 

Mittel (RVR2) zum Umwandein des Umkehrtestblldes und des registrierten Umkehrblldes In ein blnSres, um- 
gekehrtes Testbild bzw. ein binares. umgekehrtes, regtstriertes Bild, so daB ein Verhaltnis von schwarzen 
Pixeln zu Gesamtplxein in dem ersten voibestlmmten Bereteh iiegt; 

Mittel zum Speichem von Adresseninfonnation der schwarzen Pixel des binfiren, umgekehrten Testbildes und 
des binaren, umgekehrten, registrierten Bildes; 

Mittel (C2, C3) zum Verglelchen des binfiren, registrierten Bildes mit dem blnSren Testbild zum Auswerten 
eines ersten Grades von Konkordanz; 

Mittel zum Vergleichen des binaren, umgekehrten Testbildes mit dem binaren, umgekehrten. registrierten Bild. 
um einen zweiten Grad von Konkordanz auszuwerten; und 

Mittel (C5) zum Bestimmen, daB das Testbild und das binfire, registrierte Bild von dem gleichen Objekt her- 
ruhren, wenn sowoht der erste ais auch der zweite Grad der Konkordanzauswertung einen jewetiigen vorfoe- 
st^mten Bereich erfullen. 



Revendlcations 

1 . Proc^6 pour tralter des images pour comparer une image de test avec une ou plusleurs Images enregistrdes et 
pour estimer si lesdites images de test proviennent du mdme objet que I'une des Images enregistr^es et compre- 
nant ies dtapes de traitement conslstant h : 

a) mdmoriser une image enregistrde dans une m^moire d'image ; 

b) convertir en blnaire (B1) ladite image enregistr6e en une Image enreglstr6e binaire en utilisant chaque 
valeur de luminance de chaque pixel de ladite Image enreglstr6e, et ladite conversion binaire comprend : 

c) la d6temiination (81 c) si un rapport entre un nombre total de pixels noirs et un nombre total de pixels noins 
et de pixels blancs de ladite image enregistr6e binaire se situe k I'intdrieur d'une premifere plage 
pr6d6tennin6e ; et, si ledit rapport ne se situe pas k I'int6rieur de la premifere plage pr6d6tennin6e, recom- 
mencer r^tape b) et r^tape c) en modifiant une ou plusleurs valours de seuil jusqu'd ce qu*une image enre- 
glstrSe binaire pr6sente ledit rapport k I'int6rieur de la premifere plage pr6d6temnin6e ; 

et comprenant, de plus : 

d) r^claircissement de ladite image enregistrde binaire afin d'obtenir une Image enreglstr^e binaire dclaircie, 

e) la mdmorlsatk>n et la conversion en binaire d'une image de test de ia mSme manlfere que ladite Image 
enregistrde et robtentlon d'une image de test binaire ; 

f) la comparaison (CO. CI , C2) de ladite image enreglstr6e binaire ^alrcie et de ladite Image de test binaire 
pour d^temniner si ladite Image de test binaire provlent du mdme objet que ladite Image enregistr^, 

et ladite comparaison comprend : 

g) la determination (W3b) si un pixel noir de ladite Image enreglstr6e binaire 6claircle coTncide avec un pixel 
de ladite image de test binaire, sort lorsqu'une valeur de luminance dudit pixel nolr de ladite image enregistr^e 
binaire 6claircle ayant une adresse coincide avec une valeur de luminance dudIt pixel de ladite Image de test 
binaire ayant une adresse con-espondante. solt coincide avec une vaieur de luminance d'un pixel voisin dudit pixel 
de ladite image de test binaire ; 

et comprend, de plus : 

h) I'estlmatlon (C5) si un degr6 de concordance entre ladite image de test binaire et ladite Image enregistr6e 
binaire ^iaircie satisfait k une conditton de concordance pr6d6termln6e. et la d^temiination si ladite image de 
test binaire provient du mdme objet que ladite image enregistr^e en fonction dudit degr6 de concordance. 

2. Appareil de traitement d'image m^mortsant une ou plusleurs images enreglstr^ et comprenant : 
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des moyens pour convertir en binaire (B1) une image enregistrto en une image enregistrde blnaire, dans 
lequei iesdits moyens pour convertir en binaire dStemiinent (Bic) el un rapport entre un nombre total de pixels 
noirs et un nombre total de pixels noirs et de pixels blancs de ladite Image enregistrde se situe k I'intdrieur d'une 
premiere plage pr6d6temriin6e et, si ledit rapport ne se sftue pas k rint^rieur de ladite premiere plage pr6d4tennl- 
n6e, Iesdits moyens de conversion binaire convertissent de nouveau ladite image enregistr6e en modifiant une 
ou plusieurs valeurs de seuit Jusqu'd ce qu*une image enregistr6e binaire pr6sente ledit rapport k i'lnt^rleur de la 
premiere plage pr6ddtennin6e ; 

et comprenant, de plus : 

des moyens pour ^clalrcir ladite image enregistr^e binaire ; 

des moyens pour convertir en binaire une image de test de la m&me manidre que ladite image enregistr^e ; 
des moyens pour comparer (CO. CI, C2) ladite image enregistr^e binaire ^laircle et ladite image de test 
binaire afin de d^temiiner si ladite image de test binaire provlent du mdme objet que ladite Image enreglstr^e, 
dans iequel Iesdits moyens pour comparer sont caract^ris6s par, 

des moyens pour d^tenniner (W3b) qu'un pixel noir de ladite image enregistr6e binaire ^laircie coincide avec 
un pixel de ladite image de test binaire, soit lorsqu'une vaieur de luminance d'un pixel nolr de ladite image 
enregistrSe binaire ^laircie ayant une adresse coincide avec une vaieur de luminance dudit pixel de ladite 
image de test binaire ayant une adresse correspondante, soit coincide avec une vaieur de luminance d*un 
pixel voisin de ladite image de test binaire ; 

et comprenant, de plus : 

des moyens pour estimer (05) si un degr6 de concordance entre ladite image de test binaire et ladite image 
enregistrde binaire satisfait k une condition pr^6termin6e de concordance, et pour d^temniner si ladite Irnage de 
test binaire provient du mdme objet que ladite image enregistrde en fonctlon dudit degrd de concordance. 

Appareil de traitement d'image selon la revendication 2, comprenant, de plus : 

des moyens (IN) pour fixer une image de test pendant rentr6e d'une Image entr6e dans une m^moire d'image, 
comprenant des moyens (IN) pour estimer que les images entries sont valides lonsque ia vaieur de luminance 
moyenne se situe k Nntdrieur d'une plage prdddtemiin^, et 
des moyens (ET) pour modifier, 

rimage entr^ en urte image modifide comportant un nombre requls de pixels pour le traitement de compa- 
ralson. 

Appareil de traitement d'image selon la revendication 2, dans lequei Iesdits moyens (81) pour effectuer une con- 
version binaire comprennent : 

des moyens pour diviser (81 a) ladite image de test en une plurality de r6gions partielles, 
des moyens (81b) pour obtentr une luminance moyenne pourchacune de la plurality de regions partielles, 
des moyens (81 c) pour d^tennlner une vaieur de luminance de seuil pour chacune de la plurality de regions 
partielles et pour convertir ladite image de test en une Image de test binaire avec r6f6rence k la vaieur de 
luminance de seuil de chacune desdrtes regions partielles et des regions voisines de chacune desdites regions 
partielles, et des moyens pour obtenir le rapport entre le nombre total de pixels noirs et le nombre total de 
pixels noirs et de pixels blancs, 

et des moyens (B1 c) pour r6p6ter ladite conversion bi naire de ladite Image de test afin de modifier ladite vaieur 
de luminance de seuil jusqu'& ce que ledit rapport entre les pixels noirs et le nombre total de pixels noirs et 
de pixels blancs se situe k I'lntSrleur de ladite premidre plage pr6d6temiin6e, fimage de test binaire obtenue 
Bprks la conversion r^6\6e §tanX utilisde pour la comparaison avec ladite image enregistr^e binaire. 

Appareil de traitement d'image, selon la revendication 4, comprenant, de plus : 

des moyens (81 b) pour d^temiiner ladite vaieur de luminance de seuil d'une r^ion partielle avec rdfdrence 
k ladite vaieur de luminance moyenne (Bav(x.y)) de ladite region partielle et au molns une luminance moyenne 
d'au molns une region partielle voislne. 

Appareil de traitement d'image selon la revendication 4, dans lequei ladite vaieur de luminance de eeuil d'une 
region partielle est d^terminde comme 6tant 6gale k une vaieur pr6d4tennlnte si ladite vaieur de luminance moyen- 
ne (Bav(x,y)) de ladite r^lon partielle se situe k Tintdrieur d'une plage pr6d6tennln6e et si cheque vaieur de 
difference absolue entre ladite vaieur de luminance moyenne et cheque vaieur de luminance (f(x,y)) de cheque 
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pixel de ladite region partlelle se situe k llntdrieur d'une plage pr6d6termin6e. 

7. Appareil de traitement tfimage selon la revendicatlon 2, dans lequel lesdits moyens (2, 3) pour comparer ddter- 
minent, de plus, un degrd de discordance entre ladite image de test binaire et ladite image enregistr^e binaire en 
d^tectant une discordance des pixels noirs de ladite image de test binaire apr^ 6claircissement et des pixels 
noirs de ladite image enreglstr6e, et comparent ledit degr6 de discordance avec une valeur pr6d6termln6e. 

Appareil de traitement d'image selon la revendlcation 2, comprenant, de plus, des moyens pour m6morlser (R) 
des donn^es d'image comprenant des moyens pour compresser et enregistrer (G) des donn^es d'image en tant 
qu'lnfonnations d'adresse compressdes des pixels noirs dans une plurality dagr^gations de pixels d'une image 
valide, 

dans lequel lesdites informations d'adresse compress6es comprennent une position sur I'axe X de pixels 
noirs dans une agrdgation de pixels, un code et des donn^es ^Identification de fomiat de I'agrSgation de pixels 
respective. 

Appareil de traitement d'image selon la revendlcation 2, dans lequel lesdits moyens (CO, CI) pour comparer ladite 
image enregistrde binaire dclaircie et ladite image de test binaire comprennent des moyens (CO) pour d^lacer 
au molns fune des deux Images binaires dans un ou plusieuns intervenes afin de comparer lesdites deux images 
binaires, dans lequel chacun desdits un ou plusleufs intervalles est divls6 en une plurality d'inten^alles partiels, 

des moyens (C) pour estlmer si ladite image de test binaire satisfalt d une condition pr6d6termln6e de con- 
cordance et de discordance avec ladite Image enregistr^e binaire dans Fun desdits intervalles partiels, 
des moyens (C) pour ddplacer success ivement ledit un Intervene partial jusqu'^ ce que ladite condition pr§- 
dStermlnSe de concordance ou de discordance soit satisfaite, 
des moyens (C3) pour verifier les sections dlscordantes, et 

des moyens (C5) pour estlmer st ladite image de test binaire provient d'un m§me objet sur la base de la 
condition pr6d4termin6e de concordance et de discordance et des r^sultats provenant des moyens de verifi- 
cation. 

30 10. Appareil de traitement d'image selon la revendicatlon 2, comprenant, de plus, des moyens pour aligner ladite 
image de test binaire et ladite image enregistr6e binaire ^talrcie, 

et dans lequel lesdits moyens (C) pour estlmer, estiment, de plus, si ladite image de test binaire provient 
d'un mdme objet que ladite image enregistnSe 6claircie en fonctlon dudit degr6 de concordance et d'un degr^ de 
discordance. 

35 

11. Appareil de traitement d'image selon la revendicatlon 2, comprenant, de plus, des moyens pour aligner (CO. CI) 
ladite image de test binaire avec ladite Image enreglstr6e binaire 6clalrcie comprenant : 

des moyens (CI , W) pour ddplacer au moins Tune des deux images binaires dans un ou plusieurs intervenes 
^ afin de comparer lesdites deux Images binaires, dans lequel chacun desdits un ou plusieurs intervalles est 

divis^ en une plurality de N intervalles partiels. et 

des moyens pour estlmersl ladite Image de test binaire satisfalt k une condition pr^termin^e de concordance 
avec ladite image enregistr^e binaire dans Tun desdits N intervalles partiels ; 

des moyens pour d^lacer successivement lesdits N Intervalles partiels d'un m-i6me ordne (m est un nombre 
^ posltif) desdits Intervalles partiels ; 

des moyens (C. W) pour estimer si ladite image de test binaire provient d'un m§me objet que ladite Image 
enreglstr^e binaire lorsque ladite condition pr6d6termin6e de concordance est satisfalte avant le m-l^me ordre 
de d^lacement successif ; et 

des moyens (C) pour juger si ladite Image de test binaire provient d'un objet different de celui de ladite Image 
enreglstr^e binaire lorsque iadlte condition pr^ddtenminde de concordance n'est pas satlsfaite Jusqu'd un d6- 
placement successif du m-l6me ordre desdits intervalles partiels. de manl6re k effectuer une comparatson 
rapide k Taide desdits moyens de corr^araison. 

12. Appareil de traitement d'image selon la revendicatlon 2, comprenant. de plus : 

55 

des moyens (WH) pour d^couvrir des trous dans ladite image enregistr6e binaire, chaque trou 6tant un agr6- 
gafde pixels blancs entourSs de pixels noirs ; 

des moyens (C4) pour estimer une concordance de ladite Image de test binaire et de ladite image enreglstnSe 



8. 

10 
15 

9. 

20 
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binaire, oCi un trou dans ladite [mage enregistrde est d^termind comme ayant un trou correspondant dans 
ladite image de test binaire lofsque ies adresses desdits deux trous satisfont & une relation pr^d^tennin^e, 
et lesdites deux Images sont consld6r6es comme provenant d'un mdme objet si un nombre de trous corres- 
pendants entre ladite image enreglstrSe binaire et ladite image de test binaire se situe k Pint^rleur d'une plage 
pr6d6temiln6e. 

13. Appareil de traitement d'Image seion la revendlcatlon 2, comprenant, de plus : 

des moyens d'Inversion d'image (RVR) pour obtenir une image inverse de ladite Image de test et de ladite 
image enregistr^e m^moris^e ; 

des moyens (RVR2) pour convertir ladite image de test inverse et ladite image enregistrde Inverse en une 
Image de test invers^e binaire et en une image enregistr^e Invers^e binaire, respectivement, de sorte qu*un 
rapport entre Ies pixels noirs et la totality des pixels se sItue k flntdrieur d'une premiere plage prSddtemiinde ; 
des moyens pour m^moriser des informations d*adresse de pixels noIrs de ladite Image de test Invers6e binaire 
et de ladite Image enregistr^e invers^e binaire ; 

des moyens (C2, C3) pour comparer ladite Image enreglstr^e binaire avec ladite Image de test binaire pour 
^valuer un premier degr6 de concordance ; 

des moyens pour comparer Tlmage de test Inverse binaire avec ladite image enreglstr6e Invers^e binaire 
afin d'dvaluer un second degrd de concordance ; et 

des moyens (C5) pour determiner que IMmage de test et ladite image enregistr^e m6moriste proviennent du 
m§me objet si lesdits premier et second degr^s d'^valuatlon de concordance satisfont h une plage pr^ddter- 
min^e respective. 
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FIG. 2A 



4: IMAGE MEMORY 
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FIG. 3A 
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A 3X3PIXEL AGGREGATION EXAMPLE 

FIG.3B 
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A 4x4 PIXEL AGGREGATION EXAMPLE 

FIG.3C 
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A 4X3 PIXEL AGGREGATION EXAMPLE 
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(EXAMPLE 1): 

FINGERPRINT 
BOUNDARY 



FIG. 4 

IMAGE 10 OF IMAGE MEMORY 4 




(EXAMPLE 2): 

FINGERPRINT 
BOUNDARY ^ 



IMAGE 10 OF IMAGE MEMORY 4 



UNUSED PORTION WITHIN 
FINGERPRINT AREA 




RT(0)= {RT01.RT02,RT03.RT04.RT05} 
RB(0)= {RB01.RB02,RB03.RB04} 



(EXAMPLE 3): 

FINGERPRINT 
BOUNDARY 




RT(0)= {RT01.RT02.RT03.RT04.RT05} 
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FIG. 5 



( START ) 



L 



STEP INI 



RESET COUNTER Fa TO "0" 



L 



STEP IN2 



BEGIN INPUT PROCESSING TO <MA6E 
MEMORY. AND TEMPORARILY FIX IMAGE 



L 



STEP IN3 



DOES THE AVERAGE BRIGHTNESS VALUE^ 
OF A SPECIFIED REGION OF THE IMAGE 
FALL WITHIN SPECIFIED CONDITIONS? 

(I E.. IS THE IMAGE VALID?) 



YES 



STEP IN4 



ADD "1" TO Fa 



< 



STEP INS 



IS Fa A SPECIFIED VALUE? 



YES 



> 



NO 



STEP IN6 



CORRECTLY DESIGNATE THE 
IMAGE OF THE IMAGE MEMORY 



( END ^ 
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FIG. 6 



PROVISIONAL IMAGE 
LEFT MARGIN 



PROVISIONAL IMAGE 
RIGHT MARGIN 



(O.b) 



PROVISIONAL 
IMAGE UPPER- 
MARGIN 



(0. Yb) 



YL 



(0. Yb+YL-1 ) 



PROVISIONAL 
IMAGE LOWER- 
MARGIN 



(Xa. 0) 



(XaiXL-1.0) 



-XL- 



SMALL IMAGE REGION 



(Xh. 0) 



PROVISIONAL IMAGE REGION 
(WITHIN DOTTED LINE) 



ORIGINAL IMAGE REGION 



(0, Yh) 
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FIG. 7 



BavdUN): AVERAGE BRIGHTNESS VALUE OF PARTIAL REGION(M.N) 
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FIG. 9A 



( START ) 



SET Da=0. 

Alm=A2in=A3m=0. 

A1p=A2p=A3p=0 



SET T^AVERAGE brightness VALUE OF PARTIAL REGION+D + Da. 
IN TERMS OF THE (X. Y) RANGE IN WHICH PIXEL(X. Y) EXISTS 
IN THE PARTIAL REGION (M. N) AT THIS TIME. i. e. . THE(X, Y) 
RANGE IN WHICH K»M^X^KKM+1 AND K»N^Y^K«(N+1)-1 : 
WHEN f(X.Y)^T.A WHITE PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A BLACK PIXEL IS DESIGNATED): 
WHEN F(X, YXT.A BLACK PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A WHITE PIXEL IS DESIGNATED); 
AT THE TIME. OF DETERMINING A WHITE/BUCK PIXEL. 
BLACK PIXEL:ADD "1" TO BLACK PIXEL COUNTER (Bn) 
WHITE PIXEL:ADD "T TO WHITE PIXEL COUNTER (Wn) 



□ 



NOTE:B=BLACK PIXEL 
W=WHITE PIXEL 

® INDICATES A JUMP TO (a) OF FIG. 9B 
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FIG. 9B 



i 



TOLLOWING BINARY CONVERSION. THE RATIO OF BUCK PIXELS (Bn) 
^TO WHITE PIXELS (Wn) IS CALCULATED,!, e. .CALCULATE Rbw=Bn/(Bn+Wn).; 
^ THEN EXAMINE WHETHER Rbwl ^Rbw^Rbw2 IS VALID OR NOT. 



VALID 



NORMAL 
COMPLETION 
OF BINARY 
CONVERSION, 



NO 



Rbw>Rbw2 
(BLACK PIXELS 
PREDOMINATE) 



< Alp=0? > 



YES 



SUBSTITUTE Da-Dai 
FOR Da. SET A1m=A1p=1 



I 



Rbw<Rbw1 
(WHITE PIXELS 
.PREDOMINATE) 

jYES 



SUBSTITUTE Da+Da1 
FOR Da. SET Alp=Alni=l 



I 



I 



SUBSTITUTE Da-Da2 
FOR Da. SET A2m=A2p=1 



T 



"1^ 



SUBSTITUTE Da+Da2 
FOR Da. SET A2p''A2in^1 



I 



1 

JVes 



I 



SUBSTITUTE Da-Da3 
F0RDa.SETA3m"1 



SUBSTITUTE DafDaS 

FOR Da. SET A3p=1 



1 



f UNSUCCESSFUL COMPLETION 0F\ 
V THE BINARY CONVERSION J 



NOTE:* INDICATES A JUMP TO » OF FIG. 9A 
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FIG. 10 

EXAMPLE OF TABLE G SHOWING VALID REGIONS 

OF A FINGERPRINT (ELEMENT = G (M.N)) 

(WHENK=16."r INDICATES VALID. "0" INDICATES INVALID: 

SHAPE OF THE FINGERPRINT IMAGE IS UNRELATED TO THE 

OTHER FIGURES) 
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FIG. 11A 
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AN EXAMPLE IN WHICH THE VICINITY 
SURROUNDING Po IS NOT A HOLE 



NOTE:B=BLACK PIXEL 
W=WHITE PIXEL 
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FI6.12A 
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AN EXAMPLE IN WHICH AN IMAGE MEMORY IS DEVIDED 
USING 4X4 PIXEL AGGREGATIONS 

NOTE:B=BLACK PIXEL. W=WHITE PIXEL 



FIG. 12B 
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RIGHT HALF OF A 4x4 PIXEL AGGREGATION 
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FIG. 13A 



( START ) 



I 



STEP CO 



DIVIDE AN INTERVAL [Smln.Stnax] OF S INTO AT LEAST 

ONE PARTIAL INTERVAL [Smin(j). Sniax(j)]. 

(j=1.2 Js). AND DETERMINE SELECTION SEQUENCE 



SELECT ONE UNPROCESSED PARTIAL INTERVAL OF S IN 
ACCORDANCE WITH THE SELECTION SEQUENCE. HEREAFTER. 
THE RANGE OF S IS DETERMINED BY THE PARTIAL 
INTERVAL NUMBER j. ( j=1. 2. . . . Js). AND PROCESSING 
IS CARRIED OUT 



.'STEP CI 



^STEP Cla ] 



CALCULATE QUASI-OPTIMAL VALUES (Sa.Ha.Va) OF {S.H.V} 



/-STEP Clb 



CALCULATE QUASI -OPTIMAL VALUES {Sb.Hb.Vb) OF {S,H V} 



/-STEP etc 



CALCULATE QUASI -OPTIMAL VALUES {Sc.Hc.Vc} OF {S.H.V) 




/ST EP Cld 



CALCULATE DEGREE OF CONCORDANCE Tl(j) OF 
SUB-TEMPLATE WITH REGARD TO PRESENT PARTIAL 
INTERVAL NUMBER OF S; RENDER JUDGMENT 

Tl ^Tkl 




NOTE:SEE FIG, 13B FOR 0. (D AND © 
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FIG. 15 



C START ) 



[ 



/STEP Wl 



SEQUENTIAL SELECTION OF UNPROCESSED ANGLE $| 



L 



STEP W2 



CONVERT BLACK PIXEL ADDRESS A6GREGATI0N(Xr. Yr)OF THE 
MODIFIED IMAGE OF A REGISTERED FINGERPRINT WITHIN A 

SPECIFIED RANGE (EITHER RT(0) OR RB(0)) TO THE BLACK 
PIXEL ADDRESS AGGREGATION (XRe.YR@) OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT BY PARALLEL 
DISPUCEMENT FROM AN APPROXIMATE CENTER POINT AND 
COORDINATE AXIS ROTATION OVER ANGLE S 



/STEP W3 



CALCUUTE RATE OF CONCORDANCE FROM THE RATIO OF 
THE BLACK PIXEL ADDRESS AGGREGATION OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT TO THE BUCK 
PIXEL ADDRESS AGGREGATION OF THE MODIFIED IMAGE OF 
A" TEST FINGERPRINT. AND THEN PROCEED TO STEP W4.WHEN 
SPECIFIED. A SEARCH IS CONDUCTED FOR A NEIGHBORING 
PIXEL_I_N ORDER TO CO[^CJ_THE-DJSTORIION OF_AN IMAGE 
In THE CASE WHEN IT IS POSSIBLE TO ABANDON ThE" " " 
COMPARISON DURING THIS PROCESS. THE COMPARISON 
PROCESS IS ABANDONED AT THE DISPLACEMENT POSITION 
{S.H.V} AT THIS TIME,AND THE PROCEDURE MOVES TO STEP W4 



I 



/STEP W4 



CALCULATE RATE OF CONCORDANCE AT THE TIME OF 
MODIFYING KV IN THE SAME MANNER AS IN STEP W3 



UNPROCESSED 
S EXIST 



\ /STEP W 5 

- < CHECK WHETHER UNPROCES^ ANGLE S VALUES EXIST> 
U NPROCESSED S DO NOT EXISTj /STEP W6 



CALCULATE {S.H.V} WHICH WILL MAXIMIZE THE RATES 
OF CONCORDANCE PREVIOUSLY CALCULATED FOR EACH 
RESPECTIVE {S.KV} AND SET WITH Nm.Nc INTO 
OUTPUT INFORMATION (WHEN ONLY ONE SET {S.H.V} 
IS inputted: THE RATE OF CONCORDANCE OF THIS 
SET REPRESENTS THE OUTPUT INFORMATION) 



C END ) 
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FIG. 16A 
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FIG. 16B 

RECIPROCAL RaATIONSHIP OF CONCORDANCE 
AND APPROXIMATE CONCORDANCE 



BUCK PIXEL a OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 
(ADORESS=A) 



(CONCORDANCE) 



J 



BUCK Pixa d OF MODIFIED 
IMAGE OF TEST FINGERPRINT 
(ADDRESS=A) 



OVERLAP CHECK0 



/(CONCORDANCE WITH BLACK 
PIXEL a OF MODIFIED IMAGE 
OF REGISTERED FINGERPRINT) 



BUCK PIXEL b OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 

(ADDRESS=B) 



BUCK Pixa e OF MODIFIED 
IMAGE OF TEST FINGERPRINT 
(ADDRESS=E) 



(APPROXIMATE CONCORDANCE) 



BUCK PIXEL c OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 
(ADDRESS=C) 



/ /(APPROXIMATE CONCORDANCE WITH 
, /kACK PIXEL b OF MODIFIED IMAGE 
lA OF REGISTERED FINGERPRINT) 



(DISCORDANCE) 



( 

OVERLAP CHECK ® 
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FIG. 18 



C START ) 



L 



STEP RRl 



INPUT SPECIFIED NUMBER OF 
FINGERPRINTS FROM IMAGE 
INPUT UNIT 2 



STEP RR2 



RECIPROCAL COMPARISON OF INPUTTED 
FINGERPRINT IMAGES ACCORDING TO 
A SELECTION PROCESS 



L 



STEP RR3 



WHEN A SPECIFIED NUMBER OF CONCORDANT 

IMAGES RESULTS FROM THE COMPARISON. 

THE REGISTERED INFORMATION OF A 

REGISTERED FINGERPRINT IMAGE AT 

THE TIME OF THE OPTIMUM DEGREE OF CONCORDANCE 

FOR TEMPLATE IS REGISTERED AS AN IMAGE FOR 

REGISTRATION 



C END ) 
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FIG. 19A 



ONE TEST FINGERPRINT AND REGISTERED 
INFORMATION FROM N REGISTERED FINGERPRINTS 



TEST 
FINGERPRINT 



COMPARISON- 



REGISTERED INFORMATION ) 
REGISTERED FINGERPRINT 1 



OF 



REGISTERED INFORMATION 2 OF 
REGISTERED FINGERPRINT 2. 



REGISTERED INFORMATION N OF 
REGISTERED FINGERPRINT N 



FIG. 1 9B COMPARISON OF ONE TEST FINGERPRINT AND REGISTERED 
INFORMATION FROM N REGISTERED FINGERPRINTS 



( START ) 



.INPUT 



/SEQUENTIAL SELECTION OF 



STEP NA1 



STEP NA2 



PARTIAL SEGMENTS OF 



UN- 
DETECTEDi 



/ALIGNED INTERVALS WITHOUT OVERLAP (WHEN ALL OF THE 
PARTIAL SEGMENTS HAVE BEEN SELECTED. THE PROCEDURE 

'ENDS IN DISCORDANCE). SUBSEQUENTLY. CONDUCT COMPARISONS 
BY SEQUENTIALLY SELECTING REGISTERED INFORMATION 
i (i=1.2. •••N); 

WHEN REGISTERED INFORMATION IS DETECTED FROM THE 
COMPARISON PROCESS WHICH IS CONCORDANT WITH THE 
TEST FINGERPRINT. THIS REGISTERED INFORMATION IS 
JUDGED TO BE CONCORDANT. AND THE PROCEDURE THEN 
, ENDS. AFTER COMPARING ALL REGISTERED INFORMATION. 
kWHEN CONCOROANt REGISTERED INFORMATION CANNOT 
\b E DETECTED. THE PROCEDURE RETURNS TO STEP NA2 

I CONCORDANT REGISTERED 
i INFORMATION DETECTED 
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FIG. 20A 

REGISTRATION 



(REGISTRATION STAR?) 
1 STEP RVR1 

1 / , 

REGISTRATION PRXESSING OF REGISTERED 
FINGERPRINT. DESIGNATE REGISTRATION 
INFORMATION OF REGISTERED FINGERPRINT 
(USE OF PROCEDURE R) 

/STEP RVR2 



WHEN BINARY CONVERTING THE REGISTERED 
FINGERPRINT. REVERSE WHITE AND BLACK 
PIXELS: CONDUCT REGISTRATION PROCESSING 
OF BLACK PIXELS OF REVERSE BINARY 
IMAGE:DESIGNATE SEPARATRY THE REVERSE 
REGISTERED INFORMATION OF REGISTERED 
FINGERPRINT FROM THE REGISTERED 
INFORMATION OF STEP RVRl 
(USE OF PROCEDURE R) 



(registration end) 
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FIG. 20B 

COMPARISON 



DISCORDANT 



DIS- 
CORDANT/ 



DISCORDANT 
COMPARISON 



(comparison start) 




STEP RVMl 



BINARY CONVERSION OF GRAY-SCALE IMAGE OF 
TEST FINGERPRINT. COMPARISON PROCESSING OF 
BINARY IMAGE AND REGISTERED INFORMATION. 
AT THIS POINT. OMIT CHECK FOR.DEGREE OF 
DISCORDANCE PORTIONS 
(USE OF PROCEDURES C AND W) 



CONCORDANT 



STEP RVM2 



AT THE TIME OF BINARY CONVERSION OF THE 
GRAY-SCALE IMAGE OF TEST FINGERPRINT. 
REVERSE WHITE AND BLACK PIXELS. AND COMPARE 
REVERSE BINARY IMAGE OF TEST FINGERPRINT 
AND REVERSE REGISTERED INFORMATION OF- 
REGISTERED FINGERPRINT. AT THIS POINT, OMIT 
CHECK FOR DEGREE OF DISCORDANCE PORTIONS 
(USE OF PROCEDURES C AND W) 



CONCORDANT 






CONCORDANT 
COMPARISON 
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